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ABSTRACT 



Observations of the high redshift Universe through narrow-band filters have proven very successful in the last decade. The 4-meter 
VISTA telescope, equipped with the wide-field camera VIRCAM, offers a major step forward in wide-field near-infrared imaging, 
and in order to utilise VlSTA's large field-of-view and sensitivity, the Dark Cosmology Centre provided a set of 16 nan'ow-band 
filters for VIRCAM. These NB 118 filters are centered at a wavelength near 1.19 yum in a region with few airglow emission lines. The 
filters allow the detection of Ha emitters at z = 0.8, Hj8 and [Om] emitters al z ~ 1.4, [On] emitters at z = 2.2, and Lycf emitters 
at z = 8.8. Based on guaranteed time observations of the COSMOS field we here present a detailed description and characterization 
of the filters and their performance. In particular we provide sky-brightness levels and depths for each of the 16 detector/filter sets 
and find that some of the filters show signs of some red-leak. We identify a sample of 2 x 10' candidate emission-line objects in 
the data. Cross-correlating this sample with a large set of galaxies with known spectroscopic redshifts we determine the "in situ" 
passbands of the filters and find that they are shifted by about 3.5-4 nm (corresponding to 30% of the filter width) to the red compared 
to the expectation based on the laboratory measurements. Finally, we present an algorithm to mask out persistence in VIRCAM data. 
Scientific results extracted from the data will be presented separately. 
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1. Introduction 

The potential of narrow-band searches for redshifted emission 
lines from star-forming galaxies has been discussed in the litera- 
ture for more than two decades (e.g., Pritchet & Hartwick 1987; 
Smith et al. 1989; M0ller & Warren 1993). With the advent of 
sensitive detectors on large telescopes, large samples of e.g. Lyor 
emitting objects have been collected (e.g., Hu et al. 1998; Ku- 
jiritzki et al. 2000; Steidel et al. 2000; Fynbo et al. 2001 ; Malho- 
tra & Rhoads 2002; Fynbo et al. 2003; Hayashino et al. 2004; 
Venemans et al. 2005; Grove et al. 2009; Ouchi et al. 2009, 
2010). This selection method combines narrow-band imaging 
with observations in one or more broad-band filters. Objects 
that show excess emission in the narrow-band image compared 
to the broad-band images are selected as candidates. The result 
is a list of candidate emission-line galaxies within a narrow red- 
shift range, typically Az - 0.02 - 0.05. Multi-band photometry 



Send offprint requests to: B. Milvang-Jensen, milvang@dark- 
cosmology.dk 

* Based on observations collected at the European Southern Obser- 
vatory, Chile, as part of program 284.A-5026 (VISTA NBl 18 GTO, PI 
Fynbo) and 179.A-2005 (UltraVlSTA, Pis Dunlop, Franx, Fynbo, & Le 
Fevre) 



can be used to determine the approximate redshift of the emis- 
sion line, allowing one to distinguish e.g. between H(!'+[N ii] on 
the one hand and Hy6+[Oiii] on the other, while spectroscopic 
follow-up is often necessary to establish the exact nature of the 
emission line source and to measure the precise redshifts. 

Of particular interest is the search for Lyman- or (Lya) emit- 
ters at very high redshift as a probe of the epoch of reionization 
(Partiidge & Peebles 1967; Barton et al. 2004; Nilsson et al. 
2007). At redshifts z > 7, this search requires narrow-band 
imaging in the near-IR as the emission line moves out of the 
sensitivity range of classical CCDs. Searches for emission Une 
galaxies based on near-IR narrow-band imaging are already ma- 
turing (e.g., Willis & Courbin 2005; Finn et al. 2005; Cuby et al. 
2007; Geach et al. 2008; Villar et al. 2008; Sobral et al. 2009; 
Bayhss et al. 2011; Ly et al. 2011; Lee et al. 2012; Sobral et al. 
2012, 2013) but so far we lack any detections of narrow-band 
selected Lya emitters at z ^ 7.5 (see Shibuya et al. 2012 and 
Clement et al. 2012 and references therein). 

The advent of the VISTA telescope (e.g. Emerson et al. 2006; 
Emerson & Sutherland 2010a,b) and its wide-field camera VIR- 
CAM (Dalton et al. 2006, 2010) provides a new opportunity 
to undertake a deep, wide-field search for emission-line galax- 
ies. To take advantage of this opportunity, we acquired a set 
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of narrow-band filters (named NBl 18) for the VISTA telescope. 
The filters were designed to be about 10 nm wide and centred at 
around 1 185 nm where there is a prominent gap in the night sky 
OH forest (Barton et al. 2004). 

The NB 118 filters allow a search for a number of line emit- 
ters at various redshifts. The most prominent are Ha emitters at 
z - 0.8, Hy6 and [OIII] emitters at z » 1.4 and [Oil] emitters at 
z = 2.2. The forbidden oxygen lines are metallicity dependent, 
but also affected by AGN. Nevertheless, in particular [Oil] is 
still a good tracer of star formation and hence we will have an 
interesting handle on the star formation density at z = 2.2 (e.g., 
Sobral et al. 2012; Hayashi et al. 2013), which is complemen- 
tary to broad- or narrow-band surveys targeting similar red shifts 
(Adelberger et al. 2004; Nilsson et al. 2009). Follow-up spec- 
troscopy of these candidates can provide insight into the metal- 
licity evolution of star forming galaxies with redshift (Kewley & 
Ellison 2008). If sufficient sensitivity can be reached, the filters 
will also allow a search for Lya emitters at z = 8.8. This type 
of survey is currently being undertaken as part of the ongoing 
UltraVISTA survey (McCracken et al. 2012)'. 

In return for providing ESO with the set of 16 NBl 18 fil- 
ters (one per detector), we were awarded 3 nights of Guaranteed 
Time Observations (GTO) on VISTA (PI: Fynbo), cf. Sect. 2.2. 
This paper is the first to report results obtained with the NBl 18 
filters on VISTA. Therefore the primary purpose of the paper is 
to describe the NBl 18 filters, to characterize the data obtained 
with them, and to describe how best to reduce the narrow-band 
images. In order to quantify the performance of the filters we re- 
port on some preliminary results but the final scientific exploita- 
tion of the NBl 18 GTO data will be the subject of a separate 
paper 

This paper is organised as follows: In Sect. 2 and 3 we de- 
scribe our observations and data reduction. In Sect. 4 we de- 
scribe the NBl 18 filters and predict their filter curves based 
on laboratory measurements. In Sect. 5 we select objects with 
narrow-band excess, cross correlate with spectroscopic redshift 
catalogues, and infer the on-sky filter curves. In Sect. 6 we anal- 
yse the NBl 18 sky brightness based on observations, and we 
investigate indications of red-leaks. In Sect. 7 we use models of 
the sky background to investigate both the absolute sky bright- 
ness and the changes resulting from a shift of the wavelengths 
of the filters. In Sect. 8 we summarize the main findings. In 
Appendix A we describe the persistence masking algorithm we 
developed. 

The photometry is on the AB system (Oke & Gunn 1983) 
and the wavelengths are in vacuum, unless stated otherwise. 

2. Field selection and observations 

2.1. Field selection 

For the GTO programme described in this paper we targeted part 
of the COSMOS field (Scoville et al. 2007b) due to its wealth of 
multi-wavelength data, including data from the UltraVISTA sur- 
vey (McCracken et al. 2012). We selected our subfield within 
the COSMOS field in coordination with UltraVISTA as illus- 
trated by Fig. 1. The outer blue rectangle of size x 1.5° x 1.2° 
is the UltraVISTA contiguous region, where UltraVISTA pro- 
vides imaging in Y, J, H and Ks to varying depths (referred to as 
either "deep" or "ultra-deep"). The 4 filled stripes are the Ultra- 



' The narrow-band component of the UltraVISTA survey was origi- 
nally foreseen as a stand-alone survey called ELVIS (Emission Line 
galaxies with VISTA Survey, e.g. Nilsson et al. 2007). 
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Fig. 1. Schematic sky coverage. Blue hatched columns: stripes ob- 
served in this GTO work. Red filled columns: UltraVISTA ultra-deep 
stripes. Blue outline: UltraVISTA contiguous region. Green outline: 
HST/ACS region. 

VISTA ultra-deep stripes, where UltraVISTA additionally pro- 
vides imaging in NBl 18. The 4 hatched stripes are the stripes 
observed in this GTO program in NBl 18 (and to a smaller ex- 
tent also in J); these stripes have imaging in Y, J, H and but 
not NBl 18 from UltraVISTA. The area of the stripes is about 
0.9degl The green, jagged outline shows the HST/ACS imag- 
ing (Scoville et al. 2007a), which covers almost the full GTO 
area. 

2.2. Observations 

Observations using VIRCAM on VISTA were obtained in visi- 
tor mode during 6 half-nights (second half of the night), starting 
on the night beginning 2010 January 17. In the first 4 half-nights 
about 3 hours were spent on NBl 18 observations followed by 
about 1.5 hours on J-band observations, while in the last 2 half- 
nights all time was spent on NBl 18 observations. This is illus- 
trated by Fig. 1 1 below, which shows sky level in the two filters 
versus time. The moon was below the horizon all the time. The 
seeing in the obtained images, as computed by the QualityFITS 
tool, had a median value of 0.83" and a mean value of 0.89". 
The mean airmass of the NBl 18 observations was 1.19. 

The sky coverage of VIRCAM in a single exposure, the so- 
called pawprint, is illustrated in panels (a)-(c) of Fig. 2. A paw- 
print covers 0.6 deg" on the sky (16 detectors each 2048^ pixels 
with a scale of 0.34" px '). The 16 detectors are widely spaced, 
with gaps that are slightly less than a full detector in X and half 
a detector in Y. The 3 particular positions on the sky shown by 
the pawprints in panels (a)-(c) are named paw6, paw5 and paw4 
within the UltraVISTA project. They are spaced in Y (here Dec) 
by 5.5', and by combining exposures taken at these 3 positions, 
one gets a set of 4 stripes or columns (see Fig. 2d) in which each 
pixel typically receives data from 2 of the 3 pawprints. 

The observing strategy employed in this project was to ob- 
tain a single exposure at each pawprint position and then move 
to the next, in the sequence paw6, paw5, paw4; paw6, paw5, 
paw4; etc. The moves paw6-^paw5 and paw5^paw4 were al- 
ways 5.5' in Dec, i.e. with no random component, and only in the 
paw4— »paw6 move a random component (jitter), drawn from a 
box of size 122" x 122" in RA x Dec, was added.- The lack of 
a random component in some of the telescope moves meant that 

- This sequence corresponds to the nesting parameter in the OB s be- 
ing FJPME, with the loop over J (jitter) being outside the loop over P 
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Fig. 2. (a)-(c): Individual VIRCAM exposures obtained at the positions named paw6, paw5 and paw4, respectively, (d): The NB118 stack. In 
panel (a) the detector numbers are given. North is up and east is to the left. 



Table 1. Total usable exposure time from the GTO programme 





NB118 [s] 


J[s] 


paw6 


23800 


6240 


paw5 


24080 


6000 


paw4 


24080 


6000 


stack 


47973 


12160 



Notes. The total usable exposure time is listed, i.e. after discounting 
one NB118 exposure rejected in the visual inspection (Sect. 3.4) and 
12 J-band exposures not delivered by CASU (Sect. 3.2). The exposure 
time for each of the 3 partially overlapping pawprint positions is given 
(cf. Fig. 2), as well as the typical exposure time per pixel in the stack, 
calculated as 2/3 times the sum over all pawprints. 

fake sources (so-called persistent images) were present when we 
first stacked the data, despite combining the individual images 
using sigma clipping. Only after developing a method to mask 
the fake sources in the individual images (see Sect. 3.3), the re- 
sulting stack was free of such fake sources. 

The exposure times of the individual images were 280 sec in 
NB118 (NDIT = 1, DIT = 280 sec) and 120 sec in J (NDIT = 
4, DIT - 30 sec). The total exposure time obtained is listed in 
Table 1. 

2.3. Additional imaging 

In addition to the NB118 and J-band VISTA data obtained in 
this programme, we used Y and J-band VISTA data from the 
UltraVISTA DRl dataset (McCracken et al. 2012). Specifically, 
for Y we directly use the stack and weight map from McCracken 
et al. (2012). For J, we use the individual images and weight 
maps (which McCracken et al. 2012 used to make their stack) 
and combine them with the individual images and weight maps 
from our programme (Sect. 3.4). This combined J-band stack 
has a typical exposure time per pixel of 17.2 h in the stripes of 
interest here, of which 13.8h come from UltraVISTA (Table 2 
in McCracken et al. 2012) and 3.4 h come from our programme 
(Table 1). 

We use the NB118, J and Y photometry to select candidate 
emission line objects (Sect. 5.1). 

3. Data reduction 

3.1. Processing in tlie Data Acquisition System 

VIRCAM uses Correlated Double Sample (CDS) readout mode, 
also known as Fowler- 1 sampling (Fowler & Gatley 1991; Mc- 

(pawprint); see the discussion in McCracken et al. (2012). The reverse 
order of J and P had been desirable. 



Muitry et al. 2005) and as a Reset-Read-Read sequence. This 
means that if the user requests a 280 seconds exposure (DIT = 
280 seconds, NDIT - 1), the Data Acquisition System (DAS) 
will (a) reset the detectors, (b) integrate on sky for 1 second and 
read, (c) integrate on sky for 28 1 seconds and read, and (d) write 
the difference between the second and the first readout to disk. 
This process is transparent to the user, but it has implications for 
the appearance of saturated objects (Sect. 3.3), as well as for es- 
timating the linearity of the detectors (Sect. 3.2). It also means 
that the pedestal (bias) level set by the readout electronics has al- 
ready been subtracted by the DAS, removing the need for such a 
reset correction in the subsequent reduction pipeline (Sect. 3.2). 

3.2. Processing at CASU 

All VISTA data are processed by the VISTA Data Flow System 
(VDFS) (Irwin et al. 2004) at the Cambridge Astronomical Sur- 
vey Unit (CASU). Processed images were made available to us 
by CASU on 2010 July 21. The data had been reduced with 
version 1.0 of the CASU VIRCAM pipelinel The reduced indi- 
vidual images originate from the following processing steps (cf. 
the CASU web site"*, the VISTA Data Reduction Library De- 
sign document available on the CASU web site, and Lewis et al. 
2010): 

- Dark correction, including correction for other additive ef- 
fects 

- Linearity correction 

- Flat field correction, which corrects for small-scale varia- 
tions in the quantum efficiency as well as for the vignetting 
of the camera. Furthermore, the global flat field properties 
of each detector are used to gain-normalise each detector 
to a common (median) system. We have assumed this me- 
dian gain to be 4.19 ADU"', see the CASU web site''; we 
only use the value to calculate the sky brightness in electrons 
(Sect. 6). The headers (keyword GAINCOR) only give the 
applied scale factor for each detector 

- Sky background correction 

- Destiiping 

- Astrometric and photometiic calibration 

The VIRCAM data show no evidence of detector crosstalk or 
sky fringing, so the pipeline does not need to correct for these 
effects (Lewis et al. 2010). 

^ http : //casu. ast . cam. ac .uk/surveys-projects/vista/ 
data-processing/version- log 

http : //casu . ast . cam . ac . uk/surveys-pro j ects/vista/ 
technical/data-processing 

' http : //casu . ast . cam . ac . uk/surveys-pro j ects/vista/ 
technical/vista- gain/vista- gains 
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In our further processing at TERAPIX (Sect. 3.4) we undo 
the sky subtraction and the destriping in order to redo them in an 
improved version. We also redo the astrometric and photometric 
caHbration. 

Reduced images were provided for all 258 obtained NBl 18 
exposures, but only for 152 of the 164 obtained J-band ex- 
posures. The latter problem seems to be due to the J-band 
OBs (Observation Blocks) being interrupted and restarted at two 
points due to minor technical (software) problems, which makes 
the CASU pipeline incorrectly classify some of the data taken as 
bad or unwanted. Since plenty of additional J-band data subse- 
quently became available from UltraVISTA, this minor loss of 
data was not a problem. 

Stacks were also provided by CASU, but we did not use these 
for the following reasons: the data were only stacked in smaller 
portions (typically for each night and each of the 3 pawprints), 
the data did not have our TERAPIX sky subtraction, and our 
persistence masking had not been applied. 

3.3. Creation of persistence masks 

The VIRCAM detectors do have some persistence, in which a 
somewhat bright star (down to say J w 16) leaves a faint fake 
source at the same position on the detector in the next 1 or 2 im- 
ages. For our observing pattern (nesting) such faint fake sources 
would add up in the stack, and it was therefore necessary to 
deal with this problem. We developed a masking algorithm that 
masks the affected pixels in the individual images, thus exclud- 
ing those pixels when stacking the data. This algorithm is de- 
scribed in Appendix A. An illustration of persistence in individ- 
ual VIRCAM images is given in the top row of Fig. A.l. The 
effect of persistence in the stack of our data without and with 
our persistence masking is illustrated in Fig. A. 2. 

3.4. Processing at TERAPIX 

We used the TERAPIX (Traitement Elementaire, Reduction et 
Analyse des PIXels) facility to process the individual reduced 
images from CASU (Sect. 3.2). This processing was similar to 
that done for the UltraVISTA DRl data, and we refer to Mc- 
Cracken et al. (2012) for details. Here we will mention the main 
points. 

The 410 individual images (x 16 detectors) and a number of 
diagnostic plots based on these were visually inspected within 
the Youpi^^ environment (Monnerville & Semah 2010). One 
NBl 18 image, namely the very first taken for this project, was 
found to contain a strange diagonal stripe, and was therefore 
flagged for exclusion from the stacking. Unlike for UltraVISTA 
DRl, we did not additionally reject images based on the PSF 
size or ellipticity. 

The individual images from CASU were stacked to produce 
a first-pass stack, which in turn was used to produce an object 
mask for each individual image. The CASU sky subtraction and 
destriping was undone by adding the sky frames provided by 
CASU. A new sky subtraction was performed with the follow- 
ing two key features: (1) Masking of objects was based on the 
above-mentioned first-pass stack of all the data. For compar- 
ison, the CASU sky subtraction for this dataset used masking 
based on a mask we provided, which was based on existing Ks 
and i-band data. (2) For each image a sky frame was constructed 
from the images in a window of +20 min centered on the image 
in question (also known as running sky or sliding sky). Since 

* http://youpi.terapix.fr/ 



the NBl 18 images typically are spaced by 4.9 min, typically 8 
images were used to create the sky frame, namely 4 images be- 
fore and 4 after For the images at the start or end of a sequence 
(an OB), only 4 images were used. For comparison, the CASU 
sky subtraction for this dataset consisted of creating a sky frame 
based on fixed groups of 6 NBl 18 images (corresponding to a 
time span of about 30 minutes) and using that sky frame to sky 
subtract all 6 images. When inspecting the individual images as 
sky subtracted by CASU, we noted that the large-scale sky back- 
ground was less flat for the images at the ends of such a 6 image 
sequence than for the images in the middle of the sequence. 

In addition to redoing the sky subtraction, the destriping was 
redone. Finally, large-scale gradients were fitted and subtracted 
using SExtractor^ (Bertin & Amouts 1996). 

Weight maps were generated for each image, incorpo- 
rating the computed persistence masks (Sect. 3.3), enabling 
persistence-free stacks to be made. 

For each image the astrometric and photometric solutions 
were computed using SCAMP** (Bertin 2006). 

The individual images were regridded and stacked using 
SWarp** (Bertin et al. 2002). The regridding (interpolation) was 
done to the same tangent point and pixel scale of 0. 15" px"' used 
in UltraVISTA and in most available images for the COSMOS 
field. For reference, the native pixel of VIRCAM is 0.34" px ' . 
The stacking was done using sigma clipping (at 2.8cr); a modi- 
fied version of SWarp was used to accomplish this. 

We created two stacks: an NBl 18 stack based on the GTO 
data, and a J-band stack based on both the GTO and the Ultra- 
VISTA DRl data (McCracken et al. 2012). 

3.5. Test using fhe CASU sky subtraction 

As a test, we stacked the individual NBl 18 images as sky sub- 
tracted by CASU. This was done in almost the same way as for 
the individual images as sky subtracted by TERAPIX. Specif- 
ically, SWarp was run with the same parameters and the same 
individual SCAMP files (containing the astrometric and photo- 
metric solutions) were used. The only difference was that we 
let SWarp fit and subtract large-scale gradients in the individ- 
ual images, since such gradients were clearly present. However, 
this is a rather unsatisfactory procedure, since the objects are not 
masked. 

The result was a stack that on large scales was worse than 
the TERAPIX one, but which on small scales to our surprise 
was better, which was evident both visually and using empty 
aperture measurements (Sect. 3.8), where the improvement in 
noise was 0.4 mag. We have tracked the problem down to a bug 
in the TERAPIX sky subtraction code, where images sometimes 
are shifted by 1 pixel in x and/or y, and the shifted bad pixels 
are often no longer masked by the bad pixel mask and hence add 
to the noise. Also other small-scale variations in the background 
create additional noise in this way. A new version of the software 
is currently being tested, and in subsequent papers we will use 
re-reduced data. For this paper we have based our photometry 
on the TERAPIX stack with this higher noise level. Since most 
results presented in this paper are based on objects with red shifts, 
hence typically bright objects, the additional noise does not pose 
a problem here. 

Note that in the above test, we stacked the 257 individual 
NBl 18 images as sky subtracted by CASU, not the 18 NBl 18 

' http : //www . astromatic. net/sof tware/sextractor 
* http : //www . astromatic. net/software/scamp 
' http : //www . astromatic. net/sof tware/swarp 
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Fig. 3. Empty aperture noise measurements for the GTO NB 118 data. The rectangles in panel (a) show the regions used to analyse the empty 
aperture measurements. The detector(s) contributing data in the given region are listed, and parenthesis indicate regions that have half the exposure 
time of the other regions. Panels (b) and (c) give the 2" diameter 5cr AB mag values for the current NB118 TERAPIX stack (which has a sky 
subtraction problem; Sect. 3.4) and our NB118 stack based on the CASU sky subtraction (which is better, but probably still not the best possible 
version of our data; Sect. 3.5), respectively. The aperture correction to total magnitude of 0.34 mag has not been subtracted. 



stacks made by CASU (at the native pixel scale) of the data com- 
ing from a given OB and pawpiint, with this NB 118 dataset con- 
sisting of 6 OBs (one per night) and 3 pawprints. We expect that 
(a) only stacking once, i.e. going from the individual images to 
the stack, and (b) using a finer pixel scale to (marginally) recover 
spatial resolution is the better procedure. 

3.6. Photometry 

Photometry was performed using SExtractor Objects were de- 
tected/defined in the NBl 18 image, and fluxes in identical aper- 
tures were measured in the NBl 18, J and Y-band images. 

Isolated bright but unsaturated stars were located in a 
FWHM versus magnitude plot. The typical seeing (FWHM, as 
measured by SExtractor), was 0.89" forNB118, 0.87" for J, and 
0.88" for Y. Using circular apertures of 2.0" and 7.1" diameter 
(following McCracken et al. 2012), the aperture correction be- 
tween these two apertures was found to be 0.34 mag for NBl 18, 
0.32 mag for J, and 0.35 mag for Y. Typically, 1000 stars were 
used and the standard deviation was 0.01 mag. The 2.0" di- 
ameter aperture magnitudes with these aperture corrections sub- 
tracted are used throughout this paper It should be noted that the 
used aperture corrections only are correct for unresolved objects. 
Conversely, it should be noted that the different bands have al- 
most the same seeing, so the aperture corrections are not critical 
for the derived colours. 

The errors on the aperture magnitudes computed by SExtrac- 
torare are too small due to, among other things, correlated errors 
introduced by the resampling. We used the empty aperture mea- 
surements (Sect. 3.8) to derive a typical correction factor of 2.7 
to the SExtractor flux (i.e. counts) errors. This method is similar 
to the simulations done by McCracken et al. (2010). 

3. 7. Masking of bad regions of tlie stacks 

In the analysis we mask certain regions of the stack where it is 
diflicult to extract correct photometry. Near the edges of the 4 
stripes the sky subtraction quality goes down due to the 122" 
jittering (Sect. 2.2), i.e. due to fewer images being used in the 
computation of the sky frame. We mask 1' around the edges of 



the 4 stripes. We also mask regions contaminated by reflections 
from bright stars, based on a visual inspection. Finally we mask 
part of the detector 7 region, which has problems in this reduc- 
tion. We mask ^ 10% of the stack. 

3.8. Deptli of tlie obtained stacks 

To measure the depth in the stacks we proceed as follows. We 
first run SExtractor in the given stack to detect the objects. This 
produces a so-called segmentation image, which identifies all the 
pixels that contain signal from objects. We then place as many 
non-overlapping circles of 5" diameter as possible in the image 
in such a way that the circles do not contain any object pixels. 
At the centre of these circles we force SExtractor to perform 
aperture photometry in circular apertures with a range of sizes; 
here we will report the results for the 2" diameter apertures. 

To accurately track the depth as function of detector (or as 
function of each of the 16 NBl 18 filters), we identify regions in 
the stack that are fully covered by exactly 2 of the 3 pawprints. 
These regions are shown in Fig. 3(a). On the figure the detector 
number(s) contributing data to the given region are given. A la- 
bel such as "2" indicate that the region only contains data from 
detector 2. There are two such regions: the top one gets data 
from paw4 and paw5, and the bottom one from paw5 and paw6. 
The area between these two regions is covered either by 2 or 3 
pawpiints (the average is 2.2 pawprints) and hence has a 10% 
larger exposure time per pixel. These areas are not analysed in 
the following depth analysis. The regions with the detector num- 
ber given in parenthesis are special cases: they are fully covered 
by exactly 1 pawprint and thus have half the exposure time per 
pixel of the other regions. 

For detector 16 the regions take into account that our weight 
maps for the individual images remove 3.3' on the south side 
and 5.5' on the east side as this part of the detector is deemed 
unreliable. For detector 4 we remove 1 ' on the west side. 

Each region contains typically 2,500 empty aperture flux 
measurements. The standard deviation cr of these values is cal- 
culated and turned into a Scr AB magnitude. The results for our 
TERAPIX stack (Sect. 3.4) are shown in Fig. 3(b) and for our 
stack based on the CASU sky subtraction (Sect. 3.5) in Fig. 3(c). 
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It is seen that on average the CASU sky subtraction is deeper by 
0.4 mag than our current TERAPIX sky subtraction, which we 
know has a problem and for which a new version of the software 
currently is being tested. The CASU-based stack still has some 
problems. As an example the destriping does not work as well as 
in the TERAPIX pipeline, so we expect that a future reduction 
will produce a slightly deeper stack. 

For both stacks there is a substantial variation in the noise 
within the stack. Using the numbers from Fig. 3(c), the lowest 
noise (ca. 23.9 mag) is found for detectors 1, 6 and 10, and the 
highest noise (ca. 23.2 mag) is found for detectors 2, 3, 13 and 
14. This difference strongly tracks the difference in sky bright- 
ness, as will be discussed in Sect. 6.1 — see e.g. Table 3. 

The median (over the 16 detectors/filters) 5cr noise is 
23.21 mag for the current TERAPIX stack and 23.59 mag for 
the CASU-based stack. Subtracting the point source aperture 
correction of 0.34 mag (Sect. 3.6) we obtain the corresponding 
detection limits of 22.87 mag and 23.25 mag, respectively. These 
values can be converted into 5cr detection limits in line flux of 
6.7x10"'^ erg s"' cm"^ and 4.7x10"'^ erg s"' cm"^, respectively, 
via 

F = 3.0 X 10'** ^ 10-0-4(mAB+48.60) ^-1 ^^^-2 ^ 

using typical values of the filter width w - 123 A and wavelength 
A - 1 1910 A (Sect. 4). However, since the filters are not tophats, 
the detection Umit in line flux will vary with wavelength across 
the filter. 

4. The NB118 filter curves based on laboratory 
measurements 

Searches for emission lines in the J band are difficult due to the 
many strong telluric emission lines (mainly due to hydroxyl, 
Rousselot et al. 2000) at that wavelength band. Only a lim- 
ited number of wavelength intervals are suitable (e.g. Nilsson 
et al. 2007). Among these is the window at 1 185 nm, which cor- 
responds to a Lyo' redshift of z = 8.8. This specific window 
is free from strong skylines within the wavelength range from 
1179nm to 1196nm and is the target of the NB118 VIRCAM 
filters. These narrow-band interference filters were specified to 
have a central vacuum wavelength of 1 185 nm (within 2 nm) and 
a FWHM of lOnm (within 2 nm) at an operating temperature of 
100 K and in a convergent f/3.3 beam, which was to be approx- 
imated as a collimated beam at an angle of incidence of 7°. In 
addition, the specifications placed limits on the out-of-passband 
leaks: the average transmission between 700 nm and 1140nm 
should be below 0.1%, and the average transmission between 
1250 nm and 3000 nm should be below 0.01%. 

A total of 20 individual filters were delivered in 2007 by 
NDC Infrared Engineering of which 16 were installed in VIR- 
CAM (one filter in front of each of the 16 detectors) and four 
were kept as spares. With the delivery of the filters, the manu- 
facturer provided measurements of the transmittance in the col- 
limated beam at normal incidence at room temperature over the 
wavelength range 1100-1300nm with a sampling of 1 nm. The 
wavelength type was not specified; we have assumed it to be air. 
The manufacturer stated that the central wavelength of the filters 
would move down 7 nm with cooling and cone angle, and that 
the bandwidth at 10% would increase by 0.9 nm. 

NDC has in April 2013 provided information about the fil- 
ters based on recent measurements done by NDC on filter parts 

http://vjww.ndcinfrared.com 



still in their possession, using more accurate equipment than was 
available originally. NDC now predicts that the central wave- 
length of the filters would move down 5.2 nm with cooling and 
cone angle. 

We will now derive this shift in wavelength for the 1 6 NB 118 
filters installed in VIRCAM. When using narrow-band inter- 
ference filters in fast convergent beams under cryogenic tem- 
perature, several considerations have to be taken into account 
(e.g. Reitmeyer 1967; Parker & Bland-Hawthorn 1998; Morelli 
199 1 ). First, the passband of the filters is temperature dependent. 
In VIRCAM there is no temperature sensor on the filters, only 
on the filter wheel hub. This latter temperature is reported in the 
headers of the individual images, and for this dataset the median 
value is 101.4 K, with a range of 101. 1-101. 7 K. Paranal Sci- 
ence Operations estimate that (a) the typical filter temperature is 
90K ± 5K, and (b) the filters typically are 5-10 K colder than 
the filter wheel hub, which for this dataset would imply a filter 
temperature of 91-96 K. We will assume a filter temperature of 
90 K in our calculations. 

The temperature difference between room temperature 
(295 K) and operating temperature (90 K) gives rise to a blue- 
ward shift of the passband of 3.8 nm, based on a linear relation 
of 0.0186 nm/K measured by NDC in 2013. 

Second, VIRCAM has no collimated beam and the filter 
wheel is located in the fast convergent beam (f/3.25 at the 
Cassegrain focus, Dalton et al. 2006) of VISTA. This means 
that effectively a superposition of rays with various incidence 
angles is passing the filter A ray with incidence angle away 
from the normal will experience a blue-shifted passband, due 
to the decreased optical path difference of interfering rays (e.g. 
Morelli 1991). Therefore, the effect of a convergent beam is a 
further shift of the passband to shorter wavelengths compared to 
the normal incidence collimated curve. This is accompanied by 
a transformation of the passband, which is mainly a broadening 
(e.g. Lissberger 1970; Bland-Hawthorn et al. 2001). The shift 
and transformation depends slightly on the position of the filter 
in the focal plane. The calculation uses an effective refractive in- 
dex of 2.2, as quoted by NDC in 2013. We also assume that the 
incidence angle of the chief-ray can be estimated from the posi- 
tion of the object as 7.15° per degree distance from the centre of 
the FOV(Findlay 2012). 

Based on the first principles described above, we calculated 
the expected transmittance for each of the 16 NB118 filters ac- 
cording to their position in the cryogenic convergent beam of 
VIRCAM from the available collimated beam measurements 
(more details will be given in Zabl et al., in prep.). In the calcula- 
tion we assume that both a change of temperature and a change 
of incidence angle (still for a collimated beam) only shifts the 
filter curve and does not change the shape. However, measure- 
ments of filter curves in the literature at different incidence an- 
gles show different extents of deviations from this assumption 
(e.g. Vanzi et al. 1998; Ghinassi et al. 2002). Therefore, the cal- 
culated curves must be understood as an approximation. 

In Fig. 4, all the original collimated beam measurements per- 
formed at room temperature are shown in the first row of panels , 
while the same curves shifted to 90 K are shown in the second 
row. The convergent beam transformed curves, including the 
temperature shift, are shown in the third row. Additionally, the 
complete response function including detector QE, primary and 
secondary mirror reflectivity, and an atmosphere of airmass 1 .0 
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Fig. 4. Four difll'erent steps in the determination of transmittance curves shown for each of the 16 individual copies of the NB118 filter in 
VIRCAM. First row: CoUimated beam measurement at room temperature as provided by the manufacturer NDC. Second row: Shift as expected 
due to the temperature difference. Third row: Theoretical conversion to the convergent beam. Fourth row: Response function including all 
theoretical filter transmittance, mirror reflectivity, detector QE, and atmospheric transmission (PWV = 1 mm, airmass = 1). In the plot, the 16 
filters are separated into subsets of four filters corresponding to the four columns or stripes of the combined image (cf. Fig. 2d). In addition, the 
other 12 filters are shown in every panel in light gray. Positions and relative strengths of the sky emission lines are also included. 



1.0 
gO.8 
^ 0.6 

fD 
-i-i 

"I 0.4 
I 0.2 
0.0 



I I I 



T — I — I — I — I — I — I — I — I — I — I — I — I — I — I — I — r 



J, I il'^JSi^A A I I I- I -1 i--^-! I -:^sCr<A.A...L.. 



I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I 
- ■ Measurement NDC ^— Measurement ESO 




100 



80 



60 



40 



20 S 



1000 



1500 



2000 
Jnm] 



2500 



3000 1180 1185 1190 1195 1200 1205 1210 



X^gjnm] 



Fig. 5. Filter curves for the 4 spare filters. These filters are relevant since they are the only ones that have two sets of measurements available: by 
NDC over 1 100-1300 nm (dashed lines) and by ESO over 800-3000 nm (solid lines). Each colour represents one of the four filters. The left panel 
shows the full wavelength range covered by our measurements from the ESO laboratory. The grey line is a sky emission spectrum (see text), and 
the dotted line represents detector QE and mirror reflectivity (see text), but not atmospheric absorption. The right panel shows a zoom near the 
passband of the filters; here both NDC and ESO measurements are available. The 16 grey curves in the background show the 16 filters installed 
in VIRCAM (these are the filter curves shown in the top row of Fig. 4). All curves have been transformed from air to vacuum, but no further 
transformations have been applied. 



and a PWV of 1 .0 mm is plotted in the fourth row, using data 
from ESO". 

The total blueshift from the measurements at room temper- 
ature in a collimated beam (Fig. 4, top row) to our calculation 
representing cryogenic temperature in the convergent beam, with 
atmosphere, mirror reflectivity and detector QE (Fig. 4, bottom 



" http : //www . eso . org/sci/facili ties/par anal/ 
instruments/vircam/inst/Filters_QE_Atm_curves . tar . 
gz — for reference, at 1 190 nm the atmospheric transmission is 99.3%, 
the detector QE is 91.6%, and the Ml and M2 reflectivities are 97.5% 
and 97.8%, respectively, which likely refer to the silver coating in use 
at the time of the GTO observations. The other optical elements in the 
system (camera entrance window and lenses LI, L2 and L3) are not 
considered. 



row) is 6.5 nm on average over the 16 filters (detectors), where 
3.8 nm comes from temperature and 2.7 nm comes from the con- 
vergent beam. The temperature shift is the same for all filters, 
whereas the shift due to the convergent beam is larger for the 
filters further from the optical axis. The total predicted blueshift 
is 6.9 nm for the outermost filters (1, 4, 13 and 16), and 6.1 nm 
for the innermost filters (6, 7, 10, 11). 



The 16 final cryogenic convergent beam curves, T{A), at 
their respective positions within the beam have an average mean 
wavelength Aq of 1 187.4 nm, with a minimum of 1 184.4 nm (fil- 
ter 2) and a maximum of 1189.2nm (filter 9), where the mean 
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wavelength of the given filter is calculated as 



/ T(A)AdA 
J T{A)dA 



(2) 



(e.g. Pascual et al. 2007). The FWHM of these curves is 12.3 nm 
on average over the 16 filters, and ranges from 11.5 nm (filter 1 5) 
to 12.9 nm (filter 4). 

Due to inevitable production differences, the individual 
NBl 18 filters differ slightly from each other The 20 filters man- 
ufactured were carefully inspected for obvious production prob- 
lems (Nilsson 2007). One filter had a problem and was desig- 
nated as spare. The 3 filters with the most blue central wave- 
lengths were also designated as spare. The remaining 16 filters 
were installed in VIRCAM in such a way that the 4 filters in a 
given column of filters/detectors were as identical as possible. In 
the "stripe" observing pattern used both here and in Ultra VISTA 
for the NBl 18 observations, data from different filters/detectors 
are only mixed within a column (cf. Sect. 2.2 and Fig. 2). By 
this arrangement of the filters, the effect of an effective band- 
pass broadening on the reachable line depth and the minimum 
detectable equivalent width is minimised. 

In this work (Sections 6 and 5.3) we conclude that the 16 
NBl 18 filters in VIRCAM have some problems: the passband 
is shifted to the red, and some filters show signs of red-leaks. 
For this reason the 4 spare filters become important. For logis- 
tical reasons it was not possible to obtain an independent mea- 
surement of the 16 filters that were installed in VIRCAM, so 
for these only the NDC measurements over 1100-1300nm are 
available. However, we had the 4 spare filters re-measured at 
ESO, allowing a check of the NDC curves. Furthermore, the 
ESO measurements were performed over the wide wavelength 
range of 800-3000 nm, allowing a check of possible red-leaks 
in these filters. The comparison of the NDC and ESO measure- 
ments is shown in the right panel of Fig. 5. Both sets of mea- 
surements agree reasonably well in shape. However, the central 
wavelengths measured by NDC are about 0.7 nm shorter than 
those measured at ESO. The uncertainty in the ESO measure- 
ments is estimated to be 0.4 nm. 

The full wavelength range of the ESO measurements is 
shown in the left panel of Fig. 5. In addition to some smaller 
leaks spread over the complete wavelength range, substantial 
leaks exist near 2675 nm for three out of the four spare filters . 
According to NDC, a leak at this wavelength would be where the 
coated blocking meets the absorption on the BK7 substrate. The 
average transmission in the range 1 250-3000 nm for the four 
spare filters is 0.022%, 0.019%, 0.020%, and 0.012%, where 
the main contribution in the first three cases is coming from the 
2675 nm leak. A level of 0.020% violates the specifications by a 
factor of two. 

Although the 2675 nm leaks are mainly outside the efficiency 
range of the detectors, thermal sky light passing through these 
leaks might significantly increase the background level for these 
filters (had they been used in the instrument). We estimated the 
contribution from the leaks to the sky-background based on the 
Gemini Observatory theoretical sky spectrum'- calculated using 
Lord (1992) for an airmass of 1.0, a PWV of 2.3 mm and at an 
atmospheric temperature of 280 K. For the calculation, we have 
shifted the measured transmittance curves by 6.5 nm towards the 
blue to account for the expected passband shift. The sky spec- 
trum is shown in the left panel of Fig. 5. 



http : //www. gemini . edu/ sciops/telescopes-and- sites/ 
observing- condition- constraints/ ir-background- spectra 



Then, we calculated the fraction of detected sky photons 
passing the filters both in and out of the main passband. Here, 
we define the filter passband by the wavelength range 1165- 
1210nm, where by specification the transmittance outside these 
interval boundaries was required to be below 1%. We found 
that if the spare filters were used in VIRCAM, sky hght pass- 
ing through the out of passband leaks would contribute 37%, 
33%, 38%, and 26% to the total sky background, respectively. 
We further note that the wavelength range 2500-2770 nm alone 
would contribute 23%, 22%, 24%, and 8%, respectively. These 
calculations should be considered as crude estimates for several 
reasons. First, the used sky spectrum seems to overpredict the 
inter-line telluric background. Second, we do not have estimates 
for the accuracy of most of the used data. Third, we are using the 
quantum efficiency (QE) curve as used in the ESO exposure time 
calculator However, the QE is probably varying at some level 
from detector to detector, which could have strong consequences 
on the impact of the 2675 nm leak. Fourth, we are simply assum- 
ing that the leaks are shifted due to convergent beam and tem- 
perature by the same amount as the main passband. However, a 
slightly different shift of the main red-leak would give different 
results. 

For the 16 filters installed in VIRCAM we do not have the 
required filter curve measurements to predict the effect of possi- 
ble red-leaks. However, we can study these indirectly, as done 
in Sect. 6. 

The above-mentioned sky spectrum has very high spectral 
resolution, i.e. has very narrow emission lines. For aesthetic rea- 
sons we have convolved the spectrum by a Gaussian kernel with 
a FWHM of 0.2 nm (and down-sampled from 0.02 nm to 0. 1 nm) 
to reach a spectral resolution similar to that of X-shooter and 
used that for the plots (Figs. 4, 5 and 10). In Fig. 5 this procedure 
affects how strong the skylines appear relative to the continuum 
near 2675 nm. 

In Sect. 5.3 we make a first attempt at comparing our pre- 
dicted filter curves (Fig. 4, bottom row) to the narrow-band ex- 
cess as function of wavelength as inferred from spectroscopic 
redshifts. We find that the filter curves need to be shifted approx- 
imately 3.5-4 nm to the red to match the data, while the FWHM 
values appear correct. Such a shift implies that the average mean 
wavelength /Iq of the 16 filters probably is about 1191 nm. 



5. The NB118 filter curves based on observations 

5.1. Selection of candidate emission line objects 

NBl 18 is located inside the J band, so the simplest selection of 
candidate emission line objects would use only the (J-NB118) 
colour NBl 18 is not located at the centre of the J band, so 
objects with a non-flat continuum in Fy would have a non-zero 
(J-NBl 18) colour just from the continuum slope. Since NBl 18 
is located near the blue edge of the J band, see Fig. 6, it is natural 
to additionally use the Y-band data to select candidate emission 
line objects. 

Figure 7 shows (J-NB118) vs (Y-J) for all objects that are 
detected at 5cr in NBl 18 and at 2cr in Y and J. A bright cut 
on the magnitude in all 3 bands of 18 has been imposed. The 
objects that are candidate emission line objects according to the 
criteria discussed below are shown in blue and the rest in grey. 

We want to determine the typical locus of galaxies in this 
diagram. We illustrate this by the contours, which show the den- 
sity of objects after excluding likely stars, defined as objects with 
FWHM less than 1" in the NBl 18 stack; this mainly means that 
the contours exclude the clump of objects (i.e. stars) with colours 
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(-0.1,0.0) in the figure. For objects with (Y-J) below about 
0.5 the trend is clear, and we model this with a line with slope 
-0.34, as shown by the solid line for (Y-J) < 0.45. For red- 
der objects the situation is less clear. To illustrate the range of 
(J-NB118) colours that the continua of galaxies can have in this 
part of the diagram, we show a set of Maraston (2005) models 
(see also Maraston 1998) with solar metallicity, red horizontal 
branch morphology, Salpeter IMF and an exponentially declin- 
ing SFR with an e-folding time of 0. 1 Gyr. These model spec- 
tra do not have emission lines. We have redshifted the model 
spectra to z = 1.75-2.00 as well as z = 2.20, as indicated on 
the figure. We have used the models with ages from 0.2 Gyr to 
3 Gyr (from left to right in the figure; for z = 2.20 the oldest 
model is 2 Gyr). The z = 1.75-2.00 models are interesting as 
the (J-NB118) colour moves up and down with redshift, due to 
the location of the 4000 A break and several absorption lines (in- 
cluding Balmer, Ca and Fe lines) in the NB118 and J filters. It 
is worth noting that Bruzual & Chariot (2003) models give the 
same behaviour. With the data and models in mind, we define 
a constant value if -0.153 as the "typical" (J-NB118) colour 
for galaxies with (Y-J) > 0.45, as shown on the figure by the 
solid line. The dotted line, located 0.2 mag above the solid line, 
is used as one of the criteria defining candidate emission line 
objects (see below). 

It is noteworthy that the z - 2.2 models in Fig. 7 are located 
so much below the z = 1.95 models. This means that selecting 
[On] emitters at z = 2.2 (where [On] is in the NB118 filter) is 
difficult, since either one sets the threshold in (J-NBl 18) low at 
the price of contamination by z ~ 1 .75-2 galaxies, or one sets the 
threshold high at the price of only selecting [O ii] emitter with a 
large equivalent width (EW). Using more filters than J and Y 
would help; this is beyond the scope of this paper. Note that 
this paper is mainly based on results for NB118 emitters with 
spectroscopy, which are mostly objects at lower redshifts. 

Based on the analysis above, we define a (J-NBl 18) colour 
that is corrected for the fact that the NB118 filter is not lo- 
cated at the centre of the J-band filter. This quantity is denoted 
(J-NBl 18)coir and is essentially the (J-NBl 18) colour minus 
the solid line in Fig. 7, specifically 

((J - NBl 18) 4- 0.34(Y - J) if (Y - J) < 0.45 
(J-NBl 18)co,T = ](J -NB118) + 0.153 if(Y - J) > 0.45 

[(J-NB118)H-0.07 if Y not detected 

(3) 

where the last branch refers to the object not being detected in 
the Y-band stack at 2cr, and where the applied constant (0.07) 



simply is the median correction for the rest of the objects. We 
note that Ly et al. (201 1) used a similar functional form, with a 
slope below a certain broad-band colour — (z'-J) = 0.5 in their 
case — and a constant thereafter. 

We can now define the criteria for selecting candidate emis- 
sion line objects. These criteria are similar to those used in many 
previous studies (e.g. Geach et al. 2008; Shioya et al. 2008; Vil- 
lar et al. 2008; Sobral et al. 2009; Ly et al. 201 1; Nakajima et al. 
2012; Lee et al. 2012; Sobral et al. 2012, 2013). 

First, we require the objects to be detected at 5cr in NBl 18 
and at 2cr in J; we do not place any constraints on Y. Recall that 
throughout this paper we use errors that are based on the SEx- 
tractor flux errors scaled up by a factor to correct for the effects 
of correlated eiTors introduced by the resampling (Sect. 3.6). In 
principle we could remove the requirement on J, but see below. 

Second, we require 

(J-NB118)con- >0.2 . (4) 

This translates into a minimum observed-frame EW of 29 A (for 
filter 1 at the peak transmittance of the filter) for the objects 
where the continuum colour (i.e. the colour in the absence of 
the emission line) is well modelled by Eq. 3. This is probably 
the case for the line emitters at z < 1 .5 but not for those at z = 2.2 
(i.e. [On]). 

Third, we require the corrected colour to be positive at 2.5 cr 
significance, i.e. 

(J-NB118)con >2.5(r(j_NBii8w , (5) 

where we simply calculate the uncertainty cr(j_NBii8)„n by prop- 
agating the magnitude errors on NBl 18 and J (and Y where 
applicable) through Eq. 3. In the literature often a global un- 
certainty is used, but we have used the individual uncertainties, 
which automatically track the varying noise (depth) across the 
NBl 18 stack 

The above selection produces a sample of 1831 candidate 
emission line objects out of 45,232 objects that are detected at 
5cr in NBl 18 and at 2cr in J (after masking of bad regions, etc.). 

As stated, we have implemented the selection expressed by 
Eqs. 4 and 5 in terms of magnitudes. We can do this since we 
have required the objects to be detected in J. In principle it is 
better to use the corresponding equations based on counts rather 
than magnitudes (e.g. Bunker et al. 1995), since then objects that 
are undetected in J (possibly even having a slightly negative flux 
in J) are handled naturally. In this paper, however, we mainly 
base our results on objects with spectroscopy, and these are all 
detected in J. For reference, 25 objects are detected at 5cr in 
NBl 18 but not at 2cr in J. It is likely that most of these are 
unreal, i.e. due to noise or artefacts in the NBl 18 image. About 
half of these sources are in the unmasked part of the detector 7 
region, which has problems in this reduction. 

The selection of candidate emission line objects has already 
been illustrated in the colour-colour plot in Fig. 7. Another view 
is provided by the colour-magnitude plot in Fig. 8. Note again 
that since we use the individual uncertainties to evaluate the sig- 
nificance of the narrow-band excess (Eq. 5), the used 2.5cr se- 
lection cannot be represented by a single curve in the colour- 
magnitude plot. 

As an alternative to the above selection method, one could 
use the (broad 1 - narrow) vs (narrow - broad2) colour/colour 
selection technique (M0ller & Warren 1993; Fynbo et al. 2003). 
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Fig. 7. (J-NB118) vs (Y-J). The blue and grey dots are objects with and without significant narrow-band excess, respectively. The contours 
show the density of objects after excluding likely stars. The blue dots additionally marked by a large symbol are line emitters confirmed by 
spectroscopy, see Fig. 8 for a legend. The solid line is meant to represent the locus of the majority of the objects. The dotted line located 0.2 mag 
above is one of the selection criteria. The symbols connected by coloured lines represent certain Maraston (2005) model galaxies (see text) without 
emission lines, placed at the 7 redshifts indicated on the panel and observed at times (from left to right) 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8, 0.9, 1.0, 
1.5, 2.0 and 3.0 Gyr (except for z = 2.2 where 3.0 Gyr is not shown). 



5.2. Cross correlation with spectroscopic redsliift catalogues 

As detailed in Sect. 4 the filters were designed to obtain the op- 
timal bandpass using formulas to compute the effect of cooling 
them to cryogenic temperatures and placing them in the converg- 
ing beam. The measured bandpasses reported in Sect. 4 were 
measured at room temperature and in a collimated beam. To 
verify how well our theoretical formulae worked, the true band- 
pass should be measured "in situ", i.e. with the filters located in 
the instrument at cryogenic temperature and vacuum, and with 
the light following the same path as during the observations, i.e. 
meeting the same optical elements and having the same super- 
position of rays from different angles. One way to achieve this 
would be using a tunable monochromatic light source combined 
with a device to uniformly illuminate the dome flat screen; we do 
not have access to such equipment. Another is to use emission 



line galaxies (and AGN) with spectroscopic redshifts. One of the 
key points in our decision to observe in the COSMOS field was 
exactly that many spectroscopic redshifts would become avail- 
able in this field. 

The largest set of redshifts used here comes from the zCOS- 
MOS project (Lilly et al. 2007). We use the zCOSMOS-bright 
20k catalogue, which essentially is a superset of the zCOSMOS- 
bright 10k catalogue (Lilly et al. 2009)'-'. This is based on a 
magnitude limited [Iab < 22.5) sample. We mainly use redshifts 
that are classified as either secure or very secure, namely those 
with any of the following zCOSMOS confidence classes: 3 and 
4 (stars and galaxies), 13 and 14 (broad-line AGN), 23 and 24 
(serendipitous stars and galaxies), and 213 and 214 (serendipi- 

" See also http://archive.eso.org/cms/eso-data/data- 
packages/zcosmos- data-release- dr2 .html 
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Fig. 8. Narrow-band colour-magnitude diagram. The blue dots are objects with significant narrow-band excess, and those with a spectroscopic 
redshift in certain intervals are additionally marked with large symbols, as per the legend on the figure. The small grey dots are objects without 
significant narrow-band excess. The horizontal dotted line marks one of the selection criteria, see the text. 



tous broad-line AGN). In addition we use redshifts with confi- 
dence class 9, corresponding to a single-line redshift where the 
spectrum does not show signs of the object being a broad-line 
AGN. Specifically we use the subclasses 9.5 + 9.4 -i- 9.3 (see 
Lilly et al. 2009). A detail to note on these single line redshifts 
is that there are only two possible interpretations of the line seen 
in the zCOSMOS optical spectrum, namely [On] or Ha, and 
therefore only two possible redshifts. Since the two possible so- 
lutions are vastly different they will not cause us any problems. 
Either the redshift is correct and we record a line, or the redshift 
is wrong and the object does not matter for our purposes. And 
in fact, for the sample of candidate emission line objects with 
redshifts (Table 2), including class 9 does not add any "unidenti- 
fied" objects while adding 3 [S ii] emitters, 5 Ha+[Nii] emitters 
and 2 Hy6+[Oiii] emitters. Finally, we also use class 18 (single- 
line redshift, broad-line AGN): this adds 2 H/3-i-[Om] emitters. 
The reported typical 1 sigma redshift uncertainty in zCOSMOS- 
brightis 110 km s"'. 



We also use the redshift catalogue from the COSMOS AGN 
spectroscopic survey, as published in Trump et al. (2009). This 
is based on optical spectroscopy using Magellan/IMACS and 
MMT/Hectospec of X-ray selected objects. Again we only use 
redshifts that are classified as secure, which corresponds to their 
listed confidence classes 3 and 4. 

Finally we use redshifts from early spectroscopic follow-up 
of objects identified as line emitters in this work (cf. Sect. 5.1) 
and as likely to have [On] in the NB118 filter based on photo- 
metric redshifts from Ilbert et al. (2009). All the 3 objects that we 
observed (PI: Zabl, ESO ID 089.B-0710) with VLT/X-shooter 
(Vernet et al. 2011) were indeed found to be [On] emitters at 
z - 2.2 (Zabl et al. in prep.). 

For all redshift catalogues we performed the cross correla- 
tion with our photometric catalogue using the tskymatch2 rou- 
tine in stilts'"* (Taylor 2006). We used a maximum distance 



http : //www . starlink . ac . uk/stilts/ 
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Fig. 9. Narrow-band colour versus spectroscopic redshift. The large blue symbols are objects with significant narrow-band excess (Sect. 5.1). 
The symbol type indicates the spectroscopic catalogue, as per the legend given on the figure. The redshifts of strong emission lines or emission 
line blends selected by the NB118 filters are marked for a typical filter vacuum wavelength of 1191 nm (but note that the central wavelengths of 
the filters in the 4 columns of the stack differ somewhat, see the bottom row of Fig. 4). Panels (b) and (c) provide zooms, in which the dashed lines 
mark the line blends as shown in panel (a), while the dotted lines mark the individual lines that are part of the line blends. The low values of the 
colour atz~ 0.9 (see panels a and b) are due to the Ho- line being in the J band but not in the NB 118. 



of 0.5". For objects with a selected redshift both from zCOS- 
MOS and Trump et al. (2009) we used the zCOSMOS value. In 
the vast majority of these cases the redshifts are concordant. 

In Fig. 9 we plot (J - NB118)corr versus redshifts from the 
3 catalogues: circles: zCOSMOS-bright 20k, squares: Tmmp 
et al. (2009), stars: X-shooter (Zabl et al. in prep.). Large, blue 
symbols are objects with significant narrow-band excess as de- 
fined in Sect. 5.1, and small, grey symbols are the remaining 
objects. Panel (a) shows the full redshift range up to z = 3.5, 
while panels (b) and (c) show zooms near the redshifts of cer- 
tain emission lines. The redshifts of a number of emission lines 
are marked by dashed lines. In panel (a) certain neighbouring 



emission lines have been shown by a single dashed line for clar- 
ity, e.g. [S ii]67 18,6733, whereas panels (b) and (c) additionally 
show the individual emission lines as dotted lines, e.g. [S ii]6718 
and [S ii]6733. All rest-frame (vacuum) wavelengths were taken 
from the Atomic Line List'''. The dashed and dotted lines corre- 
spond to a filter wavelength of 1 191.5 nm, a number adjusted by 
eye to get a good match to the data in this figure. In this figure 
data from all the 16 NBl 18 filters are mixed (and not every filter 
has the same number of redshifts), and it should be kept in mind 
that the different filters are expected to have somewhat different 



http : //www . pa . uky . edu/~peter/ atomic/ 
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Table 2. Spectroscopically Identified Line Emitters 



Emission line(s) 


Air names^ 




Z2 




[Sra]9533 


[Sm]9531 


0.238 


0.260 


9 


[Sm]9071 


[S m]9069 


0.301 


0.324 





[Sii]6718,6733 


[Sii]6716,6731 


0.753 


0.788 


14 


Ha+[Nii] 


Ha+[Nii] 


0.793 


0.834 


56 


H;S+[Oiii] 


UJ3+[Om] 


1.357 


1.471 


10 


[Oii]3727,3730 


[On]3726,3729 


2.165 


2.224 


3 


Mg 1:2796,2804 


Mg 112796,2803 


3.211 


3.297 





Unidentified 


Unidentified 






3 



Notes. The table contains the candidate emission line objects with se- 
cure spectroscopic redshifts (see text). Each row corresponds to an 
emission line or a group of emission lines defined by the redshift in- 
terval zi,Z2- The last row gives the number of objects that do not fall 
into any of these redshift intervals; one of these objects is likely an 
Mg II emitting AGN, see text. Names using the air wavelengths of 
the emission lines 



wavelengths, as shown by the 16 filter curves in the bottom row 
of Fig. 4. We expand on this topic in Sect. 5.3. 

The main conclusion from Fig. 9 is that the set of 16 NBl 18 
filters do indeed function as intended, in that objects with sig- 
nificant NBl 18 excess are almost always located at the redshifts 
corresponding to strong emission lines. The breakdown by emis- 
sion line is given in Table 2. Most of the NBl 18 excess objects 
with redshifts in the catalogues used here are z 0.8 Ha emit- 
ters. 

The redshift limits Zi,Z2 used to define the identification with 
a given emission line(s) in Table 2 were calculated as the range 
that is within +0.85 x FWHM(filter) from the emission line(s) in 
question, using a typical filter FWHM of 12.3 nm and a typical 
filter wavelength of 1191 nm. In reality these values vary a bit 
from filter to filter. The factor of 0.85 is somewhat arbitrary, but 
it gives a reasonable match to the data (compare the limits given 
in Table 2 to Fig. 9). With this definition, 3 objects are uniden- 
tified. Most of these are probably objects that are classified as 
emission line objects due to fluctuations in the photometry. A 
likely exception is the object at z = 3.302 (Fig. 9a), which is 
just outside the redshift interval defining Mg ii2796,2804. This 
object is listed in the zCOSMOS catalogue as a broad-line AGN, 
so it is likely that the object has a broad Mg ii emission line that 
could cause the observed NBl 18 excess. 

5.3. Inferred central wavelength of the filters 

The plot of (J-NB118)con versus redshift (Fig. 9) suggests that 
we may infer the central wavelengths of the 16 NBl 18 filters 
from emission-line objects with spectroscopic redshifts. The 
calculation of observed-frame wavelength from redshift (/lobs - 
(1 +z)/irest) is most simply done for strong single (isolated) emis- 
sion lines or for emission line blends where the constituent emis- 
sion line are close in redshift. 

For our analysis we will use the single line [S m]9533 and 
three line blends, for which the effective wavelengths are derived 
as follows. For the [S ii]6718,6733 and [O ii]3727,3730 doublets, 
where the intensity ratio depends on the electron density Hp, we 
have used [Sii]6718/[Sii]6733 = 1.3 and [Oii]3730/[Oii]3727 
- 1.3, which in both cases correspond to rie ~ 10^ cm"^, 
which is a typical value (Osterbrock & Ferland 2006). The 
resulting effective wavelength for [S ii] is 6724.5 A and for 
[On] is 3728.7 A. For the Ha+[Nn] blend of 3 fines, the dou- 



blet ratio [Nn]6583/[Nn]6548 is essentially fixed by atomic 
physics to a value close to 3 (e.g. Storey & Zeippen 2000), 
whereas the [Nii]6583/Hq' ratio depends on the metallicity and 
on the source of photoionization and varies substantially. We 
have used [Nii]6583/Ha = 0.3, which in terms of A^2 = 
log ([N ii] 65 8 3 /Hot) (e.g. Denicolo et al. 2002) corresponds to 
A^2 Si -0.5, which is a reasonable mean value (e.g. Kennicutt 
1992; Gallego et al. 1997; Kauffmann et al. 2003; James et al. 
2005; Moustakas & Kennicutt 2006; Pascual et al. 2007; Perez- 
Montero et al. 2013; Hopkins et al. 2013). The resulting effective 
wavelength for Hq'-i-[Nii] is 6568.0 A. 

Ideally we would like to analyse the data for each detector 
(i.e. each NBl 18 filter) separately, but in our combined image 
the data from different detectors are to some extent mixed within 
the 4 columns (stripes) of the image, and the number of objects 
with redshifts is not really large enough to allow such a split. We 
therefore only split the data into the 4 columns. It should also be 
noted that the 4 filters in a given column were chosen to be as 
identical as possible. 

The plots of (J-NB118)con versus inferred observed-frame 
wavelength is given in Fig. 10. The 4 rows of the figure cor- 
respond to the 4 emission lines/blends used ([Siii]9533, [Sii], 
Hq;+[Nii] and [On]), which therefore also correspond to 4 red- 
shift slices. The 4 columns of the figure correspond to the 4 
columns of the combined image. The underlying data and the 
symbols in Fig. 10 are the same as in Fig. 9. The grey filter 
curves (identical to the coloured filter curves in the bottom row 
of Fig. 4) represent our calculation of where the filters should be, 
as operated in the instrument, i.e. at cryogenic temperature and 
in the converging beam. It is seen that these curves do not pro- 
vide a good match to the data: in many panels there are objects 
with significant narrow-band excess on the red side of the filters 
and a lack of such objects on the blue side. If these filter curves 
are shifted by 3.5 nm to the red, as shown by the coloured filter 
curves, a much better match to the data is provided. 

The 3.5 nm shift was found to be the best overall value that 
visually matches the data in Fig. 4. We have also, for each of 
the 4 columns, calculated the weighted mean wavelength of the 
galaxies, using (J-NBl 18)con- as weight, and calculated the dif- 
ference with respect to the mean predicted filter wavelengths 
in that column. The resulting shifts to the red for columns 1, 
2, 3 and 4 were 2.1 + 1.1 nm, 4.1 + 0.9 nm, 5.3 + 0.7 nm and 
4.6 + 1.2 nm, respectively, with the errors calculated using the 
bootstrap method. Over all columns the shift is 4.0 + 0.5 nm. 

We therefore conclude that there is a difference between the 
predicted filter curves and the actual achieved filter response 
on the sky. The data are compatible with the shift being the 
same for all 4 columns and for all 16 filters, but filter-to-filter 
differences could exist. We have re-checked all material re- 
lated to the filter definitions but we have not been able to de- 
termine the cause of this shift. As detailed in Sect. 4, the cal- 
culated total blueshift from the measurements at room temper- 
ature in a collimated beam to the operating temperature in the 
convergent beam is 6.5 nm on average over the 16 filters. The 
observed 3.5^ nm shift to the red could either imply that the 
blueshift due to temperature and convergent beam is only 2.5- 
3 nm instead of 6.5 nm, which is difficult to understand, or that 
there is some other effect at play, either some properties of the 
VISTA/VIRCAM optics that we have overlooked, or that the fil- 
ters have been affected by their environment somehow (e.g. by 
the way they are mounted or by the long exposure to vacuum). 
We note the case of the SDSS filters that changed wavelength, 
see Stoughton et al. (2002, their Sect. 4.5) and Bessell (2005). 
These filters have a red edge defined by a multilayer interfer- 
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Fig. 10. Wavelength response of the 16 NB118 filters, as illustrated by objects with spectroscopic redshifts. These plots are as Fig. 9, except 
that /iobs = (1 + z)/lrest rather than z is on the x-axis. The 4 rows of the figure correspond to 4 emission lines or emission line blends, with the 
used rest-frame vacuum wavelength listed. The 4 columns of the figure correspond to the 4 columns of the stack (see Fig. 2), where each column 
contains data from 4 NB 118 filters (namely filters 1-4, 5-8, 9-12 and 13-16 for columns 1, 2, 3 and 4, respectively), and where the con'esponding 
filter curves are overplotted. The grey filter curves are those from the bottom row of Fig. 4, while the coloured ones are the curves shifted by 
3.5 nm to the red to visually match the data. The vertical dotted lines indicate the centre wavelength of the 4 filters in the given panel before and 
after the shift. In the [S ii] panels (panels e-h) the hatched region indicate a redshift range where narrow-band excess is likely due to Ka rather 
than [S n]. In the bottom row the theoretical sky spectrum used in Sect. 4 is shown, scaled to fit the panel. 



ence edge coating (acting as a short-pass filter). It is believed 
that dehydration due to the filters being placed in vacuum caused 
the effective refractive index to decrease, causing a blueshift. It 
is not clear that this is relevant for the VIRCAM NB118 filters 
(where we observe a shift to the red), but it does indicate that the 
properties of filters can be affected by their environment. 

As far as the widths of the filters are concerned, the achieved 
widths indicated by the data in Fig. 10 are in reasonable agree- 
ment with the predictions. 

A limitation of the above analysis is that there is a degener- 
acy between intrinsic EW of the object and filter transmission, 
i.e. an object with a low value of (J-NBl 18)coit could either in- 



dicate an object with an intrinsically low EW or an object with 
an emission line that is at a wavelength where the filter has a 
low transmission. However, averaged over many objects, such 
effects will diminish. Also cosmic variance is an issue, although 
there should be little correlation between the 4 used redshift 
slices. A much improved analysis could be performed if we had 
objects with a spectroscopically measured EW of the emission 
line(s) in the NB118 window. With such data each filter curve 
could be derived with much better accuracy. 
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Table 3. Relative NBl 18 background level in the GTO data as function 
of detector number 



det 13 


det 9 


det 5 


det 1 


2.43 


1.41 


1.46 


1.00 


det 14 


det 10 


det 6 


det 2 


1.71 


1.03 


1.20 


2.05 


det 15 


det 11 


det? 


det 3 


1.48 


1.55 


1.78 


2.32 


det 16 


det 12 


det 8 


det 4 


1.54 


1.30 


1.43 


1.17 



Notes. The detectors are listed in the way they appear on the sky (N up, 
E left). The mean count rate in detector 1 is 21.2 s"' px"' (referring to 
the native scale of 0.34" px"'), and the count rate for the other detectors 
can be found by scaling with the numbers given in the table. 

6. NB118 sky brightness based on observations 

6.1. NB1 18 sky brightness in fhe GTO data 

As detailed in Sect. 4 the VIRCAM design required us to pro- 
duce 16 separate narrow -band filters, namely one for each de- 
tector Our design goal was to obtain 16 identical filters and as 
shown (Fig. 4) the pre-installation measurements showed vari- 
ations in bandpass which were of a magnitude that should not 
cause any issues. We therefore did not expect large vaiiations in 
the sky brightness level from one detector to the next. In Fig. 1 1 
we show the actual sky level in s"' px"' for all the individ- 
ual GTO images plotted as a function of time. Each detector is 
plotted with a separate symbol/colour combination. The J-band 
values have been scaled down by a factor of 20 to fit on the plot; 
this factor reflects both the much larger width and the somewhat 
brighter sky of the J band compared to the NBl 18. The used sky 
levels are those listed in the headers, computed by CASU using 
an iterative k-sigma clipped median including masking of bad 
pixels but not objects, with the iteration taking care of most of 
the object pixels (M. Irwin, priv. comm. 2012). The values were 
transformed from gain-normalised ADU to electrons assuming a 
common gain of 4.19 ADU"' (cf. Sect. 3.2). 

Fig. 1 1 shows that the nan^ow-band background level varies 
substantially from one detector to the next. The extremes are 
represented by detectors 1 and 13, with detector 13 on aver- 
age having a 2.43 times higher level than detector 1, see Ta- 
ble 3. The relative background level between any two detectors 
remains fairly constant in time (but is not fully constant, see be- 
low). By contrast, the spread in background levels in the J band 
is much smaller, as is evident from Fig. 11. 

This raises the question what causes the large variations in 
the background level of the narrow-band filter 

One possible explanation for the variations of the back- 
ground level is stray light that finds a way to the detector with- 
out passing through the filter This effect is a potentially serious 
problem for any narrow-band imaging (Fynbo et al. 1999, their 
Sect. 2). If this were the cause, we would expect the background 
level to have a systematic pattern over the 4 by 4 field spanned 
by the detectors in the pawprint. However, no obvious pattern is 
seen (see Table 3). Furthermore, stray light going around the fil- 
ters is also strongly excluded by an examination of dark frames 
taken with the dome lamps on, where essentially nothing is seen, 
meaning that the leak around the filters is well below 1 photon in 
100,000 (W. Sutherland, priv. comm. 2012). The only remaining 
explanation for the enhanced sky background are imperfections 
in the individual filter bandpass. This could be in the form of 
a too wide or shifted bandpass such that airglow lines enter the 



bandpass, or a too large red-leak. Below we show evidence that 
some of the filters have a noteworthy red-leak. And in Sec. 5.3 
we find that the effective filter curves on the sky are not those 
predicted by the laboratory measurements of filter curves. 

6.2. NBl 18 sky briglitness in all VISTA data and red-leak 
analysis 

We have further investigated the NBl 18 background level using 
the CASU QC tables '^ which for all VISTA data taken since 
the Science Verification (SV) in 2009 October list a wealth of 
quantities, including the sky brightness in mag/arcsec^. The im- 
ages used are not the individual images (as plotted in Fig. 11), 
but rather the CASU stacks of images from a single OB and paw- 
print position. The CASU sky brightness (transformed to AB us- 
ing conversions calculated by CASU'^) versus time is plotted in 
Fig. 12. Panel (a) shows the median NBl 18 sky brightness, with 
the median being computed over the 16 detectors. The median 
values over time are as follows: GTO data (red circles): 17.1, S V 
(green diamonds): 17.4, UltraVISTA (blue triangles): 17.3, stan- 
dard star fields, start of the night (grey skeletal symbols): 17.2, 
and standard star fields, rest of the night (black crosses): 17.3, 
all in mag/arcsec^. Panel (b) shows the NBl 18-J sky brightness 
difference (again using the median values of the 16 detectors) for 
all standard star observations where the same field was observed 
in the two bands within a few minutes. The median value over 
time is 1.2 and 0.5 mag/arcsec^ for observations at the start of 
the night and in the rest of the night, respectively, with the divi- 
sion being made at 90 minutes into the night. This means that 
the J-band sky shows a stronger change from bright to dark from 
the start to rest of the night than the NBl 18 sky does. Panel (c) 
shows the NBl 18 sky brightness in the individual detectors, with 
the median value subtracted. Bins of one calendar month have 
been used. The pattern is fairly constant over time. The typ- 
ical min-max span is 0.95 mag/arcsec^, in agreement with the 
factor of 2.43 span in the sky level for the GTO data (Table 3). 
The shown errorbars indicate a robust measure of the standard 
deviation. Particularly detectors 2 and 3 show a large standard 
deviation, meaning that they behave less like the other detectors 
(a behaviour that can also be seen e.g. in Fig. lie). Panel (d) 
shows the same for the J band, and here the variation is more 
than an order of magnitude smaller 

The large detector-to-detector variation in the NBl 18 (but 
not in J-band) sky brightness means that for the above-mentioned 
standard star observations done at least 90 minutes into the night, 
detector 1 has a sky brightness in NBl 18 of 17.8 mag/arcsec^ 
that is on average 0.9 mag/arcsec^ darker than that in J, whereas 
detector 13 has sky brightness in NBl 18 of 16.8 mag/arcsec^ that 
is essentially identical to that in J. 

The CASU QC database contains 1080 observations of stan- 
dard stars where the same field was observed in H, Ks, J, Y, Z 
and NBl 18 (in that order) within 15 minutes. For each detector 
we have quantified the correlation between the sky brightness in 
these 6 filters and between the ambient temperature, by means of 
Spearman rank order correlation coefficients rs and linear Pear- 
son correlation coefficients rp (e.g. Press et al. 1992). Some of 
these coefficients are shown in Fig. 13. The two panels differ 
only in the fact that panel (a) shows rs while panel (b) shows 
rp. The (/-axis shows the correlation coefficient between the sky 
brightness in the given band and the sky brightness in the Y band, 



http : //casu. ast . cam. ac . uk/vistasp/qctables 
" http : //casu. ast . cam. ac .uk/surveys-projects/vista/ 
technical/filter-set 
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Fig. 11. Sky level in e" s"' px"' (with 1 px being about 0.34" on the side) as function of time for the 6 half-nights of the GTO observing run. 
The data were taken in either NB 1 18 or J band; the J-band sky level values have been scaled down by a factor of 20 to fit on the plot, as indicated 
on the panels. For each exposure, i.e. for each point in time, the sky level in the 16 detectors is plotted; a symbol legend is provided in panel (f). 
In VIRCAM each detector has its own filter, and filter-to-filter variations within the set of the 16 NB 118 filters are likely the reason for the large 
detector-to-detector variations seen for the NB 118 sky levels. Dot-dashed lines mark the start of twilight. In panels (a) and (b), solid grey regions 
mark episodes where the OBs had to be restarted due to minor technical (software) problems, and dotted lines mark obtained J-band exposures for 
which CASU did not provide reduced images (see Sect. 3.2). The UT date for the observations in panel (a) is 2010-01-18, and each subsequent 
panel is one day later. 



where the given band is either J (green triangles), NB118 (red 
circles, labelled by the detector number) or Ks (black crosses). 
The X-axis shows minus one times the correlation coefficient be- 
tween the sky brightness in the given band and the ambient tem- 
perature. Positive values indicate that the sky gets brighter (i.e. 
smaller in mag/arcsec^) with higher temperature. It is seen that 
the J-band sky brightness correlates strongly with the Y-band sky 
brightness and not strongly with ambient temperature, whereas 
the opposite is the case for the Ks-band sky brightness, as ex- 



pected. Interestingly, the 16 NB118 filters almost span the full 
range between the J and the Ks filters. At one extreme, NB118 
filters 2 and 3 essentially show as strong a correlation with am- 
bient temperature as the Ks-band filters, indicating that these 
NB118 filters have substantial red-leaks. These two filters were 
also seen to deviate from the rest of the NBl 18 filters in the ana- 
lysis discussed above. 

To further investigate possible red-leaks in the 16 NBl 18 fil- 
ters, the ESO staff obtained a set of daytime test observations 
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Fig. 12. Sky brightness in AB mag/arcsec^ versus time in days for all VISTA observations in the CASU QC tables. Panel (a) shows the median 
NBI 18 sky brightness, with the median taken over the 16 detectors, i.e. over the 16 individual NBl 18 filters. Green diamonds: SV, blue triangles: 
Ultra VISTA, red circles: GTO, grey skeletal symbols: standard stars taken at the start of the night (either in evening twilight or in the first 90 
minutes of the night), black crosses: standard stars taken the rest of the time. Each point represents the stack made by CASU of the data coming 
from one OB and one pawprint position. There are therefore 18 GTO points from the 6 GTO OBs (one per night) each observing 3 pawprint 
positions. Panel (b) shows the NB 1 18- J sky brightness difference for standard star observations taken in these two filters almost simultaneously. 
Again the median values over the 16 detectors are used, and symbols are as in panel (a). Panel (c) shows the NBl 18 sky brightness in the 16 
individual detectors/filters minus the median NB 118 sky brightness (with the latter being what is plotted in panel a). The median value in bins of 
one calendar month is plotted. The shown eiTorbar represents the standard deviation (if it could be computed). A legend is provided on the panel. 
The sense of the !/-axis is such that e.g. detector 13 has a brighter sky and detector 1 has a darker sky. Panel (d) is as panel (c) but for J. These two 
panels have an identical scale on the y-axis in terms of mag/arcsec^ per cm on the page. The CASU magnitudes were transformed to AB using 
NB118(AB) = NBI18(Vega) + 0.853 and J(AB) = J(Vega) + 0.937. 



on 2012 November 1 1 and 25. In addition to the normal screen 
flats, where a screen is illuminated by a lamp, special screen 
flats were made with the lamp switched off and the dome oth- 
erwise dark, i.e. with the illumination coming from the thermal 
emission from the screen and the dome. Both the "lamp on" 
and "lamp off" images were dark-subtracted using dark frames 
taken the same day. The median level in each detector was mea- 
sured and converted to electrons using the gain for each detector 



as determined from data taken the same day. Finally, for each 
filter and detector, the ratio of the levels in the "lamp off" and 
"lamp on" images was computed. Over the 16 detectors, the me- 
dian off/on ratios were 0.18% in J, 2.5% in NBl 18 and 48% in 
Ks. Comparing J with NBl 18 using these numbers suggest that 
the relative importance of red-leaks in the NBl 18 filters is sub- 
stantially larger than in the J-band filters, but the stability of the 
"off" and "on" light sources between the exposures for the dif- 
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Fig. 13. Sky brightness correlation coefficients for tfie 16 detec- 
tors. Green triangles: J, red circles: NBl 18, black crosses: Ks. The 
x-axes show the coiTelation coefficient with the ambient temperature, 
while the y-axis shows the correlation coefficient with the sky bright- 
ness in the Y band in the given detector The correlation coefficients on 
the x-axes have been multiplied by minus one, since they would oth- 
erwise be negative due to the the sky brightness being in mag/arcsec". 
Panel (a) shows the Spearman rank order correlation coefficient rg while 
panel (b) shows the linear Pearson correlation coefficient rp. The indi- 
vidual NB 118 points are labelled with the detector number 



ferent filters is not fully ensured. Such problems are absent when 
comparing the off/on ratios for the 16 detectors of a given filter 
For Ks the range was small (47.1%-49.6%). For J the range was 
large (0.12%-0.30%), but the values themselves are small. For 
NB118 the range was large (1.4%-4.1%), with detectors 2 and 
3 having the highest values. These ratios are shown on the y- 
axes of Fig. 14. The x-axes shows the correlation coefficients 
between NB118 sky brightness in the given detector (using 1080 
nighttime observations taken over 1000 days) and ambient tem- 
perature, as discussed above and as shown in Fig. 13. In other 
words. Fig. 14 plots two different measures of red-leak for the 16 
NBl 18 filters against each other, and they are indeed positively 
correlated. 

It should be noted that the variation in red leak strength 
within the set of 16 filters derived here may partly reflect differ- 
ences in detector QE in the far red where the red-leaks may be lo- 
cated. In the spare filters the red-leaks are located near 2675 nm, 
see Fig. 5. We do not have the detector QE measurements for 
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Fig. 14. Two measures of the red-leak for the 16 NBl 18 filters. The y- 
axis shows the level in screen flats obtained with the lights in the dome 
off (i.e. with the light source being the thermal emission from the dome 
flat screen, the dome, etc.) divided by the level in regular screen flats 
(i.e. with the dome flat screen illuminated by a lamp). The levels have 
been dark subtracted. The x-axes show correlation coefficients between 
the NBl 18 sky brightness in the given detector (i.e. filter) and the am- 
bient temperature using all the VISTA data contained in the CASU QC 
tables. The correlation coefficients have been multiplied by minus one, 
since they would otherwise be negative due to the sky brightness being 
in mag/arcsec^. Panel (a) shows the Spearman rank order coiTelation 
coefficient rg while panel (b) shows the linear Pearson correlation coef- 
ficient rp. The labels indicate the detector number. 



the individual detectors, only for one detector, which is plotted 
in Fig. 5. 



6.3. Sky brightness near 1.19/im from other instruments 

As stated above, in the VISTAA'IRCAM NBl 18 data, the typ- 
ical (over time) sky brightness in the typical filter (over the 
16 filters) is about 17.3 mag/arc sec^ (again, AB magnitudes 
are used throughout). For the best filter, the value is about 
17.7 mag/arcsec^, and for the worst about 16.75 mag/arcsec^. 
For reference, these filters probably have an average central 
wavelength of about 1191 nm (using the predicted values from 
Sect. 4 and the inferred shift of unknown origin of about 3.5- 
4nm from Sect. 5.3) and an average FWHM of 12.3 nm. It is 
interesting to compare these VIRCAM NBl 18 sky brightness 
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values to those from other instruments having narrow-band fil- 
ters near the 1.19 yum window. 

For the KPNO 4m/NEWFlRM NB118 data of Ly et al. 
(2011), the typical sky brightness is 18.16mag/arcsec^ on av- 
erage over the field, with the best value obtained at the field cen- 
tre (18.84 mag/arcsec") and the worst at the field edge (about 
17.9mag/arcsec-) (C. Ly, priv. comm. 2013). The central wave- 
length of the filter changes with distance from the field centre. 
At the field centre, the filter has - 1 187.2 nm and FWHM = 
11.1 nm (J. Lee, priv. comm. 2013). 

For the Magellan/FourStar NBl 19 data of Lee et al. (2012), 
the typical sky brightness is 18.0mag/arcsec^ (J. Lee, priv. 
comm. 2013). The filter has = 1 190.8 nm and FWHM = 
13.7 nm (J. Lee, priv. comm. 2013). Note that this filter some- 
times is called NBl 18 instead of NBl 19. 

For the CFHT/WlRCam lowOH2 (NBl 18) data of Sobral 
et al. (in prep.), the typical sky brightness is 18.5 mag/arcsec^ 
(D. Sobral, priv. comm. 2013). The filter has A^ = 1187nm and 
FWHM = lOnm (D. Sobral, priv. comm. 2013). 

For the VLT/ISAAC NBl 19 data of Willis & Courbin 
(2005), the typical sky brightness is 18.5 mag arcsec"^. The filter 
has = 1 187 nm and FWHM = 8.95 nm. 

The sky brightness in narrow-band filters is a combination 
of inter-line sky continuum, line emission, and possibly thermal 
emission entering via a red-leak. The brightness of the inter-line 
sky continuum is debated but is likely low. For example, Sullivan 
& Simcoe (2012) found the inter- line sky continuum in the J 
band in dark time to be 19.55 mag/arcsec^ (with an uncertainty of 
about ±0.2 mag), and Tilvi et al. (2010) found the sky brightness 
between the OH lines near 1063 nm (which is in the Y band) to 
be about 21.2mag/arcsec^. 



7. Predicted sky brightness 

In this section we will calculate the predicted sky brightness for 
each of the 16 NBl 18 filters for a given model of the sky spec- 
trum. We will do this for the filter curves as predicted based on 
laboratory measurements, and for these filter curves shifted in 
small steps in wavelength AA. The aim is to evaluate the influ- 
ence of the wavelength shift of about 3.5-4 nm to the red that 
we have inferred using emission line objects with spectroscopic 
redshifts (Sect. 5.3). The aim is also to evaluate the amount of 
sky brightness caused by red-leaks — our red-leak indicators 
(Sect. 6.2) mainly provide information about the relative impor- 
tance of red-leaks within the set of the 16 NBl 18 filters, not the 
absolute sky brightness due to red-leaks. 

Here we will use the following 3 models for the sky back- 
ground. Model 1 is the theoretical sky spectrum provided by 
Gemini Observatory, as described in Sect. 4. Model 2 is the ob- 
served sky spectrum from Sullivan & Simcoe (2012). Model 3, 
like the other two models, contains a combination of sky lines 
and continuum, although not directly in the form of a spec- 
trum. The sky lines are taken from the list of wavelengths 
and intensities of sky emission lines as compiled from the lit- 
erature (Maihara et al. 1993; Ramsay et al. 1992; Oliva & 
Origlia 1992; Abrams et al. 1994) by the DAzLE team (e.g., 
Horton et al. 2004; McMahon et al. 2008) and made avail- 
able on the DAzLE web site'**, and the continuum emission of 
600 photons s"' m"^ arcsec"' finT^ is taken from Maihara et al. 
(1993). 



http : //www. ast . cam. ac .uk/~optics/dazle/sky- data/ 
oh_sky_lines . txt 



In our calculation we use the filter curves as predicted based 
on laboratory measurements, similar to those in the fourth row 
of Fig. 4, except that atmospheric absorption is not included. In 
the calculation we assume that the shape of the bandpasses is 
preserved and only a shift of the complete filter in wavelength is 
applied. 

It is important to note that since the filter curves for the 16 
NBl 18 filters installed in VIRCAM were only measured in a 
wavelength range near the central passband, our calculations of 
sky brightness do not include possible red-leaks. 

The result in terms of sky brightness versus AA is given in 
Fig. 15. The 3 models give somewhat different results. In terms 
of the effect of the filters probably being 3.5 nm redder than pre- 
dicted from the laboratory measurements, i.e. the difference in 
sky brightness between AA - 3.5 nm and AA - Onm, the ef- 
fect varies with filter and model. For model 1, the average is 
-0.39 mag (range: +0.03 to -0.66). For model 2, the average 
is -0.45 mag (range: -0.01 to -0.71). For model 3, the average 
is -0.86 mag (range: -0.22 to -1.17). The sign is such that the 
sky almost always is brighter when the filters are shifted 3.5 nm 
to the red. 

In terms of the absolute sky brightness at AA - 3.5 nm, the 
models vary a lot. On the figure the grey horizontal line marks 
the observed median (over time) NBl 18 sky brightness as mea- 
sured by the CASU QC for UltraVISTA data (Sect. 6.2); the 
values for the GTO data would be about 0. 1 mag brighter The 
difference between the observed and the predicted sky bright- 
ness can be interpreted as the contribution due to a red-leak. For 
models 1 and 2, most filters seem to have a contribution from 
red-leaks. For model 3 the sky brightness for most filters can be 
explained without red-leaks. All models predicted a much darker 
sky for filters 2 and 3 than observed, and these two filters are also 
those that show the strongest signs of red-leaks (Sect. 6.2). We 
note that our (rather uncertain) estimate of the red-leak contri- 
bution for the spare filters was typically only ~ 35% = 0.3 mag 
(Sect. 4). 

To make further progress, we should base our sky spectrum 
on flux calibrated NIR spectra from instruments at Paranal (e.g. 
X-shooter) located just 1.5 km away from VISTA and taken si- 
multaneously with the VISTA NBl 18 data in question. We are 
considering this for a future paper 



8. Summary and Conclusions 

We have designed and had installed a set of 16 narrow band fil- 
ters centred near 1.19/im in the ESO/VISTA instrument VIR- 
CAM. We here report on 3 nights of GTO observations with 
this filter set. In particular we describe its performance in terms 
of sky noise, throughput and passband and we describe in de- 
tail what we have found to be the best observing and reduction 
strategies with this filter set. 

The filters are designed to fit into a spectral region with few 
airglow lines and therefore relatively low sky background. The 
central wavelength corresponds to redshifts of z ~ 0.8, 1.4, 2.2 
and 8.8 for emission lines Ha, HyS+[0 iii], [O ii] and Lya, respec- 
tively, which combined with the large area covered by VIRCAM 
in a single exposure makes it a very powerful facility for emis- 
sion line surveys in the near-infrared. 

We found that persistence was an important issue in our data 
and that persistence from bright objects could be detected not 
only in the following image but also in the one following that. 
The strength of the persistence is not the same for all detectors 
and we therefore designed a general process for masking which 
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Fig. 15. Predicted sky brightness for the 16 NB 118 filters as function of a hypothetical filter wavelength shift AA with respect to the filter curves 
as predicted based on laboratory measurements. The results from 3 models of the sky emission spectrum are shown: solid orange line: model 1 
(Gemini Observatoiy, theoretical), dotted green line: model 2 (Sullivan & Simcoe 2012), dashed blue line: model 3 (see text). The predictions are 
based on sky continuum and emission lines near the central passband of the filters; possible red-leaks are not included. The horizontal grey line 
marks a representative value for the observed NB118 sky brightness in the given filter. The vertical grey line marks the wavelength shift to the 
red of about 3.5 nm that we infer from NBl 18 observations of emission line objects with spectroscopic redshifts. The mean filter wavelength Aq 
(Eq. 2) as predicted based on laboratory measurements is given on the panel. 



works optimally for all 16 detectors after we determine a num- 
ber of detector-dependent parameters. We describe this process 
in detail since it will be of importance for other projects using 
VISTA data, but we also point out that the problem in our data 
was enhanced by our choice of OB nesting and make specific 
recommendations for which nesting to use for this kind of ob- 
servations. 

We found that narrow-band data from different detectors 
show a large variation (factor of up to 2.43) in sky background 
and conclude that this is most likely related to slight differences 
in the passbands and/or red-leaks of the nan^ow-band filters. This 
produces variations in the depth within the combined image. 

From a cross correlation of catalogues of spectroscopic red- 
shifts in the field and a preliminary catalogue of emission line 
objects selected in our narrow-band stack we confirm that we 
are able to identify emission line galaxies broadly as expected, 
but the passband is shifted towards slightly higher redshifts. The 
shift is about 3.5-4 nm towards the red; the origin of the shift is 
unknown. 

The full scientific exploitation of the GTO data with a com- 
plete catalogue of extracted emission line objects to well defined 
detection limits will be presented elsewhere, but we did extract 
a preliminary list of emission line objects which was necessary 
in order to characterise the performance of the filters. 

As mentioned above we have cross correlated this list with 
known spectroscopic redshifts and we find that we have identi- 
fied objects at a large number of redshifts with a corresponding 
range of different emission lines in the narrow filters. In ad- 
dition to the expected strong lines ([S ii]6718,6733, Hq'-i-[Nii], 
Hj6+[Oiii] and [Oii]3727,3730) we detect the [Sm]9533 line not 



usually targeted in emission-line surveys. We also find one likely 
Mg ii2796,2804 emitter, which is classified as a broad-line AGN 
by zCOSMOS. 
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Fig. A.l. Illustration of persistence in individual VIRCAM images. The top row shows a subsection of 3 NBl 18 images (DIT = 280 sec, NDIT 
= 1) taken right after each other. The data are from detector 3, and the 3 subsections coixespond to the same pixels on the detector. In between 
each image the telescope has moved, so the subsections coixespond to different parts of the sky. The width of the section is 19", and the pixel 
scale is the native one of 0.34' px"'. In the first image a star of magnitude ivcga = H-l (2MASS) is seen. In the subsequent two images, there 
is a persistent image at the same detector coordinates as the star in the first image. The bottom row shows the persistence masks created by our 
algorithm for each image, see text. 



Appendix A: Creation of persistence masks 

Most infrared detectors suffer from persistence, i.e. a sufficiently 
bright source will produce a signal in one or more subsequent ex- 
posures. The 16 VIRCAM detectors, of type Raytheon VIRGO 
2048 X 2048 HgCdTe on CdZnTe substrate (e.g. Bezawada et al. 
2004; Bezawada & Ives 2006), are reported to have low persis- 
tence''', but the effect is nevertheless easily detectable and can 
for certain observing patterns (i.e. an unfortunate choice of the 
so-called nesting) cause severe problems, as we will show below. 
We find that the object causing the persistence (typically a star) 
does not have to be extremely bright: in our stack we would see 
persistence from stars as faint as /vega ~ 15 {Jab ~ 16) had we 
not applied our persistence masking. Furthermore, for some of 
the detectors the star does not even have to be saturated to cause 
persistence. 

At the level of the individual images, i.e. before stacking, 
persistence will be present in most VIRCAM images (regardless 
of filter). This is illustrated in the top row of Fig. A.l, where 
we show a small section of 3 images taken after each other The 
shown section is the same on the detector but different on the 
sky, as the telescope was moved between each image. The first 
image contains a somewhat bright star (7vega ~ H)- The two 
subsequent images do not contain any astronomical objects, and 
the source that is seen is the so-called persistent image of the 
star, i.e. a fake source. 

Whether persistent images will be present in the stack de- 
pends on the number of individual images being stacked and on 
the observing pattern (i.e. on the type of offsets/jitters) used to 
obtain these images: 

- If many individual images are stacked and if random jitters 
have been used between each image, then the persistent im- 
ages will not "stack up", and sigma clipping will effectively 
remove these. 

- If only a few individual images are stacked, then sigma clip- 
ping will not be able to (fully) remove the persistent images. 

" http : / /casu . ast . cam . ac . uk/ surveys-pro j ects/vista/ 
techrtical/persistence 



- If an unfortunate observing pattern is used, as is the case 
here, then stacking many images does not help, as the the 
persistent images will "stack up" and sigma clipping will not 
remove them. 

The latter situation is illustrated in Fig. A. 2. The two panels on 
the left hand side show a stack of our NB 118 data made using 
sigma clipping, but without applying the masking that we will 
describe below. The circles are located at the predicted positions 
of persistent images (fake sources) in the stack. The two panels 
on the right hand side show the stack in which the persistent 
images in each individual image have been masked, and it is seen 
that the masking removes the fake objects, while leaving real 
objects intact. Note that the masking operates on the individual 
images, not on the stack directly. 

The main point of Fig. A. 2 is that without masking we would 
have persistent images in our stack, and these could be mistaken 
for emission line objects, since they would mostly be present in 
the NBl 18 stack and less so in the J-band stack where most of 
the data come from UltraVISTA where random offsets between 
each image were used. 

The details of Fig. A. 2 are not so important, but can neverthe- 
less be described as follows. As described in Sect. 2.2, we used 
an observing pattern in which the offset between the 3 pawprint 
positions (named paw6, paw5 and paw4, see Fig. 2) was always 
5.5' in Dec, and in which a random offset was only applied after 
each set of 3 pawprints. Recalling from the top row of Fig. A.l 
that persistent images can sometimes be seen both in the first 
and the second image after a given image in which a bright star 
was located, we expect persistent images to be present in the 
stack at locations 5.5' and 11' north of bright stars. The circles 
in Fig. A. 2 correspond to modified versions of the 2MASS cata- 
logue (Skmtskie et al. 2006) in which 5.5' (top panel) or 1 1' (bot- 
tom panel) has been added to the Dec. In the 5.5' case (top panel) 
a given bright star gives rise to two persistent images separated 
by about 7" (the circles in the figure have a diameter of 15") 
mostly along the east-west direction. One comes from the star 
being in paw6 and the persistent image being in paw5, and the 
other comes from the same star being in paw5 and the persistent 
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Fig. A.2. Illustration of persistence in the stack of our data. Left: stack made without masking the persistent images (i.e. fake sources) in the 
individual images. Right: stack made with masking. The circles mark the predicted locations of persistent images in the stack, see text. The circles 
are labelled with the J-band Vega magnitude of the star that caused the persistence in question. The diameter of the circles is 15". North is up and 
east is left 



image being in paw4. The telescope movements paw6— »paw5 
and paw5— >paw4 must have had a small (about 3.5") and dif- 
ferent component in RA (in addition to the 5.5' in Dec) giving 
rise to the double appearance of these fake sources. The elonga- 
tion of sources are due to the RA component of the offset being 
slightly different for each of the 6 nights from which we have 
data. In summary, the morphology of these fake sources is fully 
understood. It is noteworthy that the fake sources in the 1 1 ' case 
(bottom panel) look like real objects and could therefore not have 
been excluded based on their morphology. 

We will now describe the algorithm we have developed for 
masking the persistent images in the individual images. The al- 
gorithm uses a set of parameters, which we derived from a set 
of VISTA data with different background levels in order to make 
the algorithm more generally applicable. Specifically, we used 
data from this work, meaning NB118 (DIT = 280 sec, NDIT 
= 1) and J (DIT = 30 sec, NDIT = 4), and NB118 data from 
the VISTA SV programme-*', with DIT ranging from 270 sec to 
860 sec, all with NDIT = 1. The SV data were also chosen since 
some of these OBs also had an unfortunate nesting, meaning that 
masking of persistence is needed to make a clean stack. 

We proceeded as follows. We first created a list of images 
taken right after each other. These images are the individual im- 
ages as reduced by CASU (Sect. 3.2). We focused on a given 
image somewhere in the list, called image 0, and we then inves- 
tigated how the pixel values in the 3 subsequent images (called 
image 1, image 2 and image 3) were correlated with the pixel 
values in image 0. When analysing each image we subtracted 
the median value to get a background that is approximately zero. 
We restricted our analysis to manually selected subsections that 
contained a star in image and no astronomical objects in the 
subsequent images. For each pixel we plotted the value in im- 
age 1 (or image 2 or image 3) against the value in image 0. Since 
the telescope moved between the two images in question, the val- 
ues should be uncorrelated. However, due to the persistence this 
is not the case; rather, a positive correction is always seen in the 



2" We used data in the field of NGC 253, ESO ID 60.A-9285(A); the 
VISTA SV is described in Amaboldi et al. (2010) and at http : //www. 
eso.org/sci/activities/vistasv/VISTA_SV.htinl 



image 1 case, and for some detectors also in the image 2 case. 
No correlations were seen in the image 3 case. 

The image 1 vs image plots for the 16 detectors are shown 
in Fig. A. 3, with the background-subtracted level in image 1 
(denoted /i ) on the y-axis and the background-subtracted level 
in image (denoted /o) on the x-axis. To reduce the noise we 
have binned the data in /o, and we have combined the different 
datasets that we analysed (see below). The persistence effect is 
clearly seen for all 16 detectors: when a certain threshold in /o 
is reached, fi becomes non-zero and increases with /q. 

The datasets that we analysed consisted of 7 sets of images, 
which spanned the two filters (NBl 18 and J) and a range of DIT 
values. In each set of images we analysed two subsections. We 
also made versions of Fig. A. 3 in which the different filters and 
DIT values were plotted separately, and no obvious dependence 
on filter or DIT were seen. The simple procedure of subtracting 
the median (i.e. the background) allowed datasets with different 
background levels to coincide in these plots, greatly simplifying 
the analysis. 

The data points in Fig. A. 3 indicate that we could in princi- 
ple correct for the persistence by using /o to predict how much 
persistence signal /i should be subtracted. However, we will do 
something simpler and more robust: we will determine a thresh- 
old in /() above which the pixel in image 1 should be considered 
unreliable and therefore be masked (i.e. be given zero weight 
when stacking the data). To determine this threshold for each 
detector, we fit functions with 3 free parameters {ki, ai and bi) 
of the form 

(ki + bi ■ (fo - ai) if/o>ai 

to the data points in Fig. A. 3. These fitted functions are shown as 
the black, solid lines in Fig. A. 3; note that the fit is (piecewise) 
linear, but the figure uses a logarithmic x-axis. We then define 
the threshold (called "threshold 1", as listed in Table A.l) above 
which we need to apply the masking as the fo value at which the 
fit reaches 3 ADU above the constant level ki (which is essen- 
tially zero). This threshold is shown as the red, dashed, vertical 
line in Fig. A. 3. For detector 5 the derived threshold seemed 
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Fig. A.3. Persistence in the 16 VIRCAM detectors. The figure is based on a number of image pairs taken right after each other, called image 
and image 1. Only subsections with a somewhat bright star in image and no astronomical object in image 1 were analysed (the telescope moved 
in between the two images). In each image the median value over the image, i.e. the background, was subtracted. For each pixel, the fluxes /o and 
/i in the two images were measured. The figure shows a plot of these, binned in /o. The persistence (i.e. detector memory effect) is seen by the 
fact that fi becomes positive above a certain threshold in fo. The black solid line is a fit to the data (Eq. A.l). The red dashed line is the threshold 
in /o at which the fit reaches a value of 3 ADU above the background, and this is used in our masking algorithm as the threshold for masking a 
given pixel (i.e. for excluding it when stacking the data). For detector 5 a lower threshold was manually set, as indicated by the blue dot-dashed 
line. The used thresholds are given on the panels and listed in Table A.l. The /o axis is logarithmic and runs from 10 to 70,000. The units are 
gain-normalised ADU, as used in the individual images reduced by CASU. 



Table A.l. Parameters used in the persistence masking algorithm 



Detector 


threshold 1 


threshold 2 


saturation 


1 


4567 


32000^ 


30000 


2 


12102 


NaN^ 


39300 


3 


1695 


12094 


39200 


4 


2959 


18417 


38900 


5 


6000 


19639 


31000 


6 


4773 


22287 


32200 


7 


9774 


19525 


30000 


8 


2206 


31632 


39300 


9 


7480 


33431 


40800 


10 


5508 


NaN 


34000 


11 


11919 


NaN 


40200 


12 


1449 


12045 


32000 


13 


972 


13391 


41400 


14 


5489 


NaN 


40200 


15 


7662 


NaN 


34000 


16 


8393 


NaN 


41800 



Notes. The units are gain-normalised ADU, as used in the individual 
images reduced by CASU, see Sect. 3.2. "NaN" (Not a Number) in- 
dicates that no threshold was set. This threshold was subsequently 
found to be too high 



too high given the data points, and we manually set it to a lower 
value, as also shown on the figure. 

The level of 3 ADU was chosen since for our data, a persis- 
tence signal below this level would lead to a signal of less than 
1 cr of the noise in the stack. 



The case of image 2 vs image is shown in Fig. A. 4. For 
some detectors, e.g. detector 12, persistence is still seen, but only 
occurring above a higher threshold in /q. For each detector, a 
function of the same functional form as before, 

/2(/o) - \ , . , „ . -f f ^ (^-^^ 

was fitted to the data points in Fig. A. 4; the fits are shown on 
the figure. To get the masking threshold we first calculated the 
level at which the fit reached 3 ADU above the constant level; 
this threshold is shown as the red, dashed, vertical line in the 
figure. Experimentation showed that slightly more masking was 
needed, so we multiplied the threshold by 0.7, shown by the blue, 
dot-dashed, vertical line in the figure. These latter thresholds are 
listed as "threshold 2" in Table A. 1 . We note that the determi- 
nation of these threshold 2 values has much higher uncertainty 
than those for image 1, since the signal is lower (cf. Fig A. 4), 
which in turn is due to only a few pixels being bright enough to 
lead to a persistence signal in the second subsequent image. This 
warrants lowering the thresholds by 30%. For some detectors no 
persistence was seen in image 2, and for these no threshold 2 
value was set (cf. Table A.l). It turned out that the stack made 
with the masking based on the thresholds in Table A. 1 contained 
a few (4 in total) surviving "image 2" persistent images from de- 
tectors 1 and 2. Therefore, the used threshold 2 values for these 
two detectors should have been set lower; this has been indicated 
in Table A.l. 

Also the image 3 vs image case was investigated, but no 
persistence was detected. 

The analysis above shows that persistence masks can be gen- 
erated simply by measuring the background-subtracted flux /o in 
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Fig. A.4. Persistence in the 16 VIRCAM detectors. This figure shows the persistence in image 2, i.e. the second image after a given image 
(image 0) containing somewhat bright pixels. In most aspects this figure is as Fig. A. 3. One difference is that the blue dot-dashed lines show the 
adopted masking threshold (given on the panels and in Table A.l), which is 30% lower than the threshold derived from the fit (marked by the red 
dashed lines). Some detectors do not show detectable persistence in image 2, and for these no threshold was derived. 



each pixel in image 0, and then flag the given pixel in the masks 
for image 1 and/or image 2 if fo is above the thresholds listed 
in Table A.l. One problem remains, related to saturated stars. 
These stars intrinsically have high fluxes in their centres, but 
in the images delivered by VIRCAM these stars can have low 
values in their centres. Such donut shaped stars with a dip or 
hole in the centre are due to the CDS readout mode where each 
image is actually the difference of a long and a short exposure, 
see Sect. 3.1 and the CASU web site-'. In an image contain- 
ing stars of a range of magnitudes, this phenomenon leads to 
the following effect. Stars with peak level below the saturation 
threshold have the shape of the expected point spread function. 
When looking at increasingly brighter stars, one first sees stars 
with flat centres, then stars with a slight dip at the centre, and 
finally stars with a dip that reaches down to zero. We found that 
the centres of these objects with dips/holes still cause persistence 
in subsequent images, even if when their flux values is below the 
thresholds of Table A. 1 . This has to be taken into account in any 
algorithm to address the persistence problem. 

We used the above findings to generate persistence mask for 
each individual image in the following manner First, we gener- 
ated versions of the images in which the holes in the centre of 
bright stars were set to a high value. We did this by first iden- 
tifying groups of connected pixels having a flux above 80% of 
the saturation level listed in Table A. 1 . For a star with a hole in 
the middle, such a group of pixels would be a ring around the 
centre of the star Within each group of connected, high-valued 
pixels, a line was drawn between all the pixels with the same x- 
coordinate, and similarly for y, and all the pixels that these lines 
passed, including pixels with low values such as those forming 
the hole/dip, were set to a high value (specifically 1.1 times the 
saturation level, but the exact value is not important). 

The mask were created from these modified images by mark- 
ing all pixel in which the median-subtracted flux in the preceding 

^' http : //casu . ast . cam. ac . uk/ surveys-projects/vista/ 
techrtical/known- issues 



image exceeds threshold 1, and in which the median-subtracted 
flux in the pre-preceding image exceeds threshold 2. These pix- 
els were considered to be affected by persistence and therefore 
ignored (i.e. given zero weight) when stacking the images. Ex- 
amples of the computed persistence masks are shown in the bot- 
tom row of Fig. A.l. Typically, 0.1% of the pixels in a given 
individual image are masked. There is some variation from de- 
tector to detector, given that some detectors (e.g. detectors 3, 12 
and 13), have stronger persistence (i.e. need less bright pixels 
to cause persistence) than others, cf. Figs. A. 3 and A. 4 and Ta- 
ble A.l. 

The algorithm works both for NDIT = 1 and NDIT > 1 im- 
ages. In the case of NDIT > 1, the FITS file contains the sum 
of the NDIT sub-exposures. The pixel values simply need to 
be divided by NDIT. Care has to be taken that CASU sets the 
BSC ALE header keyword to 1/NDIT, which makes some stro- 
nomical software (but not all) silently scale the data by this fac- 
tor 

An IDE implementation of the algorithm is available upon 
request. 

Our persistence masking algorithm was also used in the 
stacking of the UltraVISTA NB118 season 1 data (McCracken 
et al. 2012). 
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